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Chapter  1 


INTRODUCTION 

1. 1 Summary  of  Results 

Let  (v  , k i 0}  be  a discrete  time  Markov  process  with  state 

K 

space  ECf-09,")  and  let  S be  a proper  subset  of  E.  In  several 

applications  (see  [s],  f 12 ] , and  [l3])  it  is  of  interest  to  know  the 

behavior  of  the  system  after  a large  number  of  steps  given  the  process 

has  not  entered  S.  For  example,  if  vr  is  a branching  process  and 

S = {0)  a limit  theorem  for  ^vnlvm^  0 1 £ m £ n)  gives  information 

about  the  size  of  v on  the  set  (v  >0). 

n n 

In  [2],  Seneta  and  Vere-Jones  have  given  conditions  for  the 
convergence  of 

Ctjj (n)  = P(vn=}|v0=i,Ng  > n)  (1) 


1 


3 

I 


where  N =±nf (m  5 l:v  CS}.  In  many  cases,  however,  all  the  limits  in 
s m 

(1)  are  zero.  Applying  the  results  of  [2]  when  v^  is  a branching 

% 

process  and  S = {0}  gives  that  a = lim  (n)  is  a probability 

n -»  °°  * 

distribution  when  m = E(v1|vQ=l)  < 1 and  O . = 0 when  mil.  To 

obtain  an  interesting  theorem  in  the  second  case  we  have  to  look  at  the 

limit  of  (v  /c  [v„=i,  N_  > n)  where  the  c are  constants  which 
n n u s n 

t 00 . 

In  this  instance  the  most  desirable  type  of  result  is  a functional 
limit  theorem,  i.e. , a result  asserting  the  convergence  of  the  sequence 
of  stochastic  processes  {V*(t),0  £ t £ 1)  defined  by 

Vn(t>  = (v[nt]/cJv0=1'  NS>  n)  (2) 


1 


. i 

1 


where  lx]  is  the  largest  integer  £ x.  This  was  the  goal  in  the 
applications  cited  above  but  in  each  case  the  results  given  are 
incomplete  due  to  problems  with  the  tightness  argument. 

It  was  the  presence  of  these  technical  difficulties  which  motivated 
this  investigation.  The  techniques  we  have  developed  allow  us  to 
complete  the  work  mentioned  above.  While  writing  out  the  solutions 
to  these  problems  we  noticed  that  the  arguments  we  were  giving  had 
many  aspects  in  common.  To  determine  which  properties  were  used  and  how 
they  contribute  to  the  proof,  we  isolated  the  hypotheses  as  numbered 

assumptions  and  studied  their  relationships  and  consequences.  As  a ■*ij 

result  of  this  we  were  able  to  formulate  general  conditions  for  the 

process  V+  to  converge  when  S = (-",0]OE. 
n 

There  are  two  advantages  of  deriving  our  conclusions  from  a set 
of  basic  assumptions.  The  first  is  obvious:  a person  who  is  interested 
in  proving  a conditional  limit  theorem  may  apply  our  results  directly 
Instead  of  having  to  modify  our  proofs  to  meet  his  needs.  A second, 
less  tangible,  benefit  is  that  the  arguments  we  give  do  not  depend 
upon  special  properties  of  the  Markov  chain  and  so  the  proofs  may 
contribute  to  an  intuitive  understanding  of  the  conditions  needed  to 
guarantee  convergence. 

It  is  the  second  idea  which  has  been  our  guide  in  the  developments 
below.  Our  aim  has  been  to  find  assumptions  which  create  a sharp 
division  into  cases,  i.e. , so  that  the  limit  theorems  hold  under  the 
assumptions  given  and  fails  or  is  trivial  in  the  other  cases.  To 
describe  the  extent  of  our  success  we  have  to  explain  our  results 
in  some  detail. 
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We  begin  by  stating  our  three  basic  assumptions:  (i)  vfc,  k k 0 


Is  a Markov  process  with  state  space  E C(-“,®);  (ii)  there  are  constants 


c t » with  c ,/c  -*  1 so  that  if  x -»  x and  x c eE  for  all 
n n+1  n n n n 


n then 


Vn“  = (vrn.]/cJV0/cn  = Xn>  * <v|v(0)=x)  = V* 


where  V is  a Markov  process  with  nondegenerate  for  some  y > 0 

inf 


and  (iii)  P VX(s)  > 0)  > 0 for  all  t,x>  0. 

OSsSt 


Here  the  symbol  =»  means  that  the  sequence  converges  weekly 

as  a sequence  of  random  elements  of  D - the  space  of  right  continuous 
functions  on  [o,l]  which  have  left  limits.*  Nondegenerate  means  that 
P{VX=f}  < 1 for  all  f€D. 

Let  N-N,  It  is  under  assumptions  (i)-(iii)  that  we  will 


derive  conditions  for  the  convergence  of  (Vn  [N  > n)  (a)  for  all 


x -*  x a 0 and  (b)  when  x c b yeE. 
n n n 


We  will  obtain  our  conditions  for  the  case  x^-*  x > 0 by  solving 


a more  general  problem.  In  Section  2 we  give  sufficient  conditions  for 


the  convergence  of  P (•  A ) = P (*0A  )/P  (A  ) when  the  P are 

n n n n n n n 


probability  measures  with  inf  (A  ) > 0.  Applying  these  results  to 

n n n 


sets  A 


inf 


n 


f(s)  > 0)  with  t -»  tefo.l]  we  find  that  if 
ossst  n 


n x 

x x ~n 

P n and  P are  the  probability  measures  Induced  on  D by  V 
n n 


and  VX.  and  xq->  x > 0 then  Pnn(N  > nt  } PX(Tq>  t)  is 


sufficient  for  (V*n |N  > ntQ)  ■>  <V*|T0  > t)  when  TQ=inf{t  > 0: 


inf 


t/2£s£t 


f(s)  s 0). 


In  Section  2.1  there  is  a brief  description  of  this  space  end  the 
weak  convergence  results  used  in  this  paper.  Most  of  the  results  we 
will  need  can  be  found  in  [20]. 


1 

1 


1 


I ■ 

* 


4 


3 


If  x -»  0,  however,  P {N  > n)  -4  0 (in  most  cases)  so  a more 
n n 

delicate  analysis  is  required.  Our  method  for  proving  convergence  in 

this  case  will  be  to  show  that  if  T^.  = inf{k:v ,/c  S G)  then 

c k n 


lim  (vr  ,/c  v„  = x c , N > n) 
In*  J n'  0 n n 


lim  lim  (v  /c  v = x c , N > n) 

_ _ r n , nl  0 n n' 

G-*  0 n -*  “ LT^+n-  ] 


lim  lim  (v  r ,/c  v.  =Cc  , N > n) 
_ . Ln*  J n 1 0 n 

G-*  0 n -»  00 


lim  (V  |T  > 1) 
G-»  0 


In  Section  3 we  will  show  that  these  three  equalities  hold  if  (in 

y 

addition  to  (i)-(iii))  we  have 
xn  x 

(iv)  {N  > ntn)  P (T^>  t}  whenever  x > 0,  t^-»  t > 0 an 

*r, 

(v)  P (N  > n t } ->  0 whenever  x ■+  0 and  t -*  t > 0. 
n n n n 

The  key  to  our  proof  is  the  following  fact  (first  observed  by  Lamperti 

in  [25]): 

Theorem  3.2  If  (i)  and  (ii)  hold  there  is  a 6 S 0 so  that  for 
all  c > 0 VCX  = cVX(*c^).  (*) 


This  sealing  relationship  identifies  the  processes  which  can  occur  as 
limits  in  (ii)  and  can  be  used  to  deduce  many  properties  of  the  limit 
process.  In  Section  3.1  we  use  (*)  to  compute  relationships  between 


the  numbers  P (Tq  > t).  These  formulas  are  used  to  identify  trivial 
cases  and  obtain  sufficient  conditions  for  (iii),  (iv),  and  (v)  to  hold. 
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In  Sections  3.2  and  3.3  we  use  these  preliminaries  to  prove  our 

conditional  limit  theorems.  To  do  this  we  reverse  the  usual  procedure 

for  proving  weak  convergence.  In  Section  3.2  we  develop  sufficient 

conditions  for  V+  to  be  tight.  In  Section  3.3  we  find  conditions 
n 

for  the  convergence  of  finite  dimensional  distributions: 


Theorem  3.10  Suppose  (i)-(iv)  hold  and  is  tight.  If 

V+=  lim  (VX|  T.  > 1)  exists  as  is  & 0 then  V+  =*  V+  if  and  only  if 
xlO 

lim  lim  P(V+(t)  > 6}  = 1 for  all  t > 0 

610  rw®  n 


If  x c s a and  (v)  holds  this  condition  is  equivalent  to 
n n 

P{N  > nt| vQ  = a} 

lim  f ■ — i — = t~  for  some  pi  0 . 


> ni  V0  » aJ 


In  Sections  4. 1-4. 4 we  use  the  results  of  Section  3 to  prove 
conditioned  limit  theorems  for  random  walks,  branching  processes,  birth 
and  death  processes,  and  the  M/G/l  queue  which  contain  the  corresponding 
results  of  [6],  [8],  [12]  and  [l3]  as  special  cases.  It  seems  likely 
that  our  methods  can  be  extended  for  the  non-Markovian  examples  studied 
by  [7]  and  [ll],  but  we  have  not  tried  this- 

A more  interesting  unsolved  problem  is  to  prove  that  if 

n 2 2 

c v X,  is  a random  walk  with  EX,  = u < 0,  E(X  -u)  = a < • and 
°n  * L-‘  i 1 l 

i=l 

PfXj  > 0]  > 0 then  <s[n.j/an  | SQ=  O.N^  > n)  converges  to  the 
Brownian  bridge  (see  [20]  p.  84  for  a description).  Conditions  for 
convergence  are  known  if  E(e®*l)  <®  for  0e(-a,a)  (see  [4])  but 
methods  given  here  cannot  be  applied  since  (ii)  does  not  hold  for 


c = oh 

n 


5 


In  Section  4.5  we  show  that  the  developments  in  Section  3 can  be 
modified  to  prove  the  results  of  [5]  and  [l4]  for  random  walks 
conditioned  on  {N  > n)  when  B is  a bounded  subset  of  the  state 

D 

space.  This  example  suggests  that  our  results  may  be  extended  to 

conditioning  to  avoid  other  types  of  sets  S.  Unfortunately  there  are 

no  other  possibilities.  It  is  easy  to  show  that  if  (v  /c  |VQ=y,  N^>  n 

00 

converges  then  D ( U Sc  ) is  {0) , ( —CO  f 0]  f [°,“)>  or  so 

m=l  n=«i 

we  have  already  considered  the  two  reasonable  cases. 

To  generalize  our  results  we  can  consider  other  types  of  condition- 
ing. A natural  candidate  for  this  is  conditioning  on  fv^eA]  or 
{ (vn_j , v^ieB} . Several  limit  theorems  of  this  type  have  appeared  in  the 
literature  with  A = (x)  or  [a,b]  (see  [l5]-[l8])  and 
B = (-« ,0)x(0 ,<»)  (see  [19])  and  it  seems  that  our  methods  can  be 
applied.  These  conditionings  have  the  most  effect  at  times  close  to  1, 
however,  so  we  have  to  reverse  our  perspective  and  new  techniques  are 
required.  We  plan  to  consider  these  limit  theorems  in  a later  publica- 
on 
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1 . 2 Weak  Convergence  and  the  Geometry  of  D 

Let  (S,p)  be  a metric  space  and  i the  class  of  Borel  subsets 

of  S.  If  P , n £ 0 are  probability  measures  on  & and 

ff dP  -»  TfdP.  for  every  bounded  continuous  f on  S then  we  say  P » 

J n o 0 * n 

converges  weakly  to  P^  and  write  P^  =*  P . There  are,  of  course,  many 
other  definitions  of  weak  convergence. 

Theorem  1 . The  following  four  conditions  are  equivalent; 

(i)  P =>  P 
n 

(ii)  lim  JfdP^  S f fdP  for  all  bounded  upper  semicontinuous  f 
n 

(iii)  lim  P (G)  £ P(G)  for  all  open  sets  G and 

n 

n 

(iv)  P (A)  -»  P(A)  for  all  A with  P(dA)  = 0. 
n 

This  and  most  of  the  other  weak  convergence  results  we  will  need  can 
be  found  in  [20]  or  are  given  in  Section  2.  In  addition  to  the  standard 
results,  however,  we  will  need  some  special  facts  about  the  geometry  of 
D which  are  not  available  in  an  easily  quotable  form.  These  results  and 
some  related  well-known  convergence  notions  are  explained  below.  Proofs 
are  given  only  for  results  which  cannot  be  found  in  [ 20 J . 

Let  D be  the  space  of  functions  on  [0,l]  that  are  right  contin- 
uous and  have  left  limits.  Let  A denote  the  class  of  strictly 
increasing  continuous  mapping  from  [0,l]  onto  itself.  For  f and  g 
in  D define  d(f,g)  to  be  the  infimum  of  those  positive  E,  for  which 
there  exists  a AeA  such  that 


3 


1 


•1 


A 
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ir*- 


sup | A ( t) 
t 


sup)  f(t) 
t 


- t s e 


g(A(t))|  ^ £ 


It  is  easy  to  show  that  d is  a metric  for  D ([20](  p.  111). 

Many  facts  about  the  resulting  topology  for  D are  given  in  Chapter  14 
of  [20].  Two  of  these  results  which  we  will  need  later  are: 


f sup  f(t)  is  a continuous  function  (3) 

0 £ t •£  1 


if  n (f)  = f(t)  then  jr  is  continuous  if 

b t 


and  only  if  t = 0 or  t = 1 


For  this  study  we  will  need  information  about  the  continuity  of 
other  functionals  h:D  -»  R.  The  first  we  shall  investigate  is  the 
modulus  of  continuity  u^(5)  = w^(6;0,l)  defined  by 


w'(6;a,b)  = 


inf  max  ( sup  |f(s)-f(t)|) 

{t.}  l£i£r  t.  ,&s<t<t. 
i *-  i-1  1 


where  the  infimum  is  taken  over  all  sequences 
a < t <t....  <t  = b with  minCt.-t.  ^>6 


- o - 1 


i i-17 


Theorem  2 . f -*■  w7(6)  is  an  upper  semicontinuous  function. 


Proof, 


Let  t)  > 0.  Suppose  t are  chosen  for  f so  that  the  expression 

in  (5)  is  less  than  0,^(6)  + q.  If  d(f ,g)  < = qA(  min  t^t  1”6)/2 

lsi£r  1 

and  AeA  is  such  that  (1)  and  (2)  hold  for  £ = £Q , using  A(t^)  in 

(5)  gives  u'(fi)  < o ' (6)  + 2 q. 
g f 


8 


For  the  proof  of  Theorem  3.3  we  will  need  to  know  about  the 


i I 

^ ! 


, i 


i 

i 

I 

i 

< 


continuity  of  the  hitting  times  which  we  define  for  y > 0 by 
T (f)  = inf(t  > 0:f(t)  s y) 

It  is  easy  to  construct  examples  which  show  T is  not  lower  or 
tipper  semicontinuous : 

For  1 S n S let 


f (x)  = 

| (3  + l/n)x 

0 ^ x 

< 1/3 

n 1 

’ x + 1/3 

1/3  <; 

x £ 1 

j 

, (3  - l/n)x 

0 £ x 

£ 1/3 

gn(x)  = ] 

k<1/3) 

1/3  < 

x < 2/3 

x + 1/3 

2/3  < 

x <;  1 

All  is  not  lost,  however.  The  next  result  shows  that  almost  every  T^ 
is  almost  surely  continuous. 

Theorem  3.  Let  Ay  be  the  set  of  discontinuities  of  T . If  P 

y y 

is  a probability  measure  on  D then  (y>  0:P(Ay)  > 0]  is  a set  of 
Lebesque  measure  zero . 


Proof . 


Let 

T+(f)  = 

y 

inf ( t > 

A 

-p 

w 

« • 
o 

ii 

"“v 

v 

i nf  ( t > 

0:sup  f(s)  ^ 

y 

Clearly, 

/(f)  S T (f) 

y y 

N— / 

V* 

VI 
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Lemma  1 . 


T is  upper  semicontinuous . 

y 


Proof . 

If  T*(f)  < ® then  for  any  > 0 there  is  a positive 
g < T*(f)  r,  so  that  f(s)  > y.  If  d(f,g)  < = (f(s)-y)ATi  and 

XeA  is  such  that  (1)  and  (2)  hold  for  £ = then  g(A(s))  > y and 
Ms)  > 0 so  Ty(g)  < r (f)  + 2t)  . 

Lemma  2.  is  lower  semicontinuous. 

y 

Proof ■ 

If  T^(f)  = 0 the  conclusion  is  obvious.  If  T^(f)  = » then 
y y 

sup  f(t)  < y so  if  d(f ,g)  < y-sup  f(t)  , (g)  = °o.  If  0 < (f)  < <» 

t t y y 

then  for  any  positive  s < T^(f)  , sup  f(t)  < y.  If  Tie(o,s), 

y fc£s 

d(f  ,g)  < = (y-sup  f(t))Ar|  and  XeA  is  such  that  (1)  and  (2)  hold 

t^s 

for  £ = £0  thGn  sup(g(t):t  s A(s))  < y so  T^(g)  > Ms)  S s-  T\ . 


Lemma  3 . If  P is  a probability  measure  on  D then 


0:Pff:T^(f)  < T+(f)}>  0}  has  Lebesque 


measure  zero. 


Proof . 

1 

Observe  that  t (f)  < T (f)  only  if  f(0)  = y or  f is 

y y 

discontinuous  at  (f) , so  for  anv  f there  are  only  a countable 

y 

number  of  values  for  which  strict  inequality  holds  (see  [20],  p.  124). 
For  the  other  half  observe  that  the  intervals  rT  (f),T+(f))  are 

y y 

disjoint  for  different  y so  only  countably  many  arc  not  empty. 


10 


Combining  this  with  the  first  observation  gives  fy:T(i  )<T+(f>)  is 

y y 

countable  for  each  f so  applying  Fubini's  theorem  gives  the 
desired  result. 


The  proceeding  theorem  is  useful  for  proofs  in  which  we  have  some 
choice  in  deciding  which  T to  use.  The  examples  above  however  show 
that  we  can  in  general  conclude  nothing  about  a specific  hitting  time 
of  interest  (say  the  time  to  hit  (-®,0]).  As  a partial  remedy  we 
will  define  the  hitting  times  in  a slightly  different  manner  for  y = 0. 


TQ(f)  = inf { t > 0:f(t)  > 0} 


V'» 


inf{  t > 0:  inf  f(s)  <:  0} 

t/2ssst 


T'(f)  = inf ( t > 0:f(t)  s 0) 


T (f)  = inf ( t > 0:f(t)  < 0} 


We  will  work  with  T^  instead  of  the  "natural"  hitting  time 


T^  since 


{ f :f (0)  > 0,T  (f)  > t)  = (f:  inf  f(s)  > 0} 

OssSt 

is  open  (a  fact  which  is  useful  in  Section  2).  Observe  that  if 
Pfxe(-<»;oo)  are  the  transition  probabilities  of  a standard  Markov  process 
(see  [22],  9.2.v)  then  PX{T0=  T[]  = 1 for  all  x>  0. 


Chapter  2 

CONDITIONS  FOR  THE  CONVERGENCE  OF  P ( • I A ) WHEN  inf  P (A  ) > 0 

n 1 n n n 

n 


In  this  section  we  shall  investigate  conditions  under  which  the 

weak  convergence  of  a sequence  of  probability  measures  P is 

n 

sufficient  for  the  convergence  of  the  conditional  measures 

P(-|A)  = P (-D  A )/P  (A  ) when  inf  P (A  ) > 0. 
n'n  n nnn  nn 

n 

If  P (A  ) -»  P(A)  we  can  check  that  P ( • I A ) =*  P(  ■ I A)  by 
n n n'n' 

showing  that  P (B  1 A ) -»  P(B  0 A)  for  enough  sets  B.  Sufficient 
n n 

conditions  for  this  are  an  easy  consequence  of  a generalization  of  the 


continuous  mapping  theorem  ([ 20]Th . 5 . 5) . 

To  state  this  theorem  requires  L.ome  notation:  let  (S,p)  and 

(S'rp')  be  complete  separable  metric  spaces  with  Borel  fields  & 

and  & ' . Let  h n £ 0 be  measureable  mappings  from  S to  S'  and 

let  E be  the  set  of  xeS  such  that  h (x  ) -»  h-(x)  fails  to  hold  for 

n n 0 

some  sequence  x. 

Theorem  1.  If  P =>  P with  P-.(E)  = 0 then  P h ^ =>  P h * . 
n 0 0 n n 0 0 

If  the  h are  real  valued  and  there  is  an  M < ® so  that 
n 

|h  (x)|s  M for  all  n ^ 0 and  xcS  then  for  any  B with  P(dB)  = 0 
1 n 


11  h (x)P  (dx)  -»  f h (x)P  (dx) 
J n n o 0 0 


Proof . 


This  result  can  be  easily  obtained  from  the  Skorohod  representation 


theorem . 


12 


Lemma  1 . If  P , n ^ 0 are  probability  measures  on  the  complete 

separable  metric  space  S such  that  =»  P^  then  there  are  Borel 

measurable  X :(0,1)  -»  S so  that  X has  distribution  P and 

n ’ n n 

X converges  to  X almost  surely  (with  respect  to  Lebesque  measure), 
n u 


If  P (E)  = 0 and  X , n s 0 are  the  variables  of  the  lemma  for 
0 n’ 

P ,n  s 0 then  h (X  ) -»  h„(X„)  almost  surely  so  P h 1 =>  P,h  1 . To 
n’  nnOO  ' nnOO 


obtain  the  second  result  note  that  1.  „.h  (X  ) ->  l.„  „-,h.(X„) 

IX  cB]  n n I x.cBj  o o 
n 0 J 

almost  surely  and  use  the  bounded  convergence  theorem. 


To  use  this  theorem  to  obtain  a conditioned  limit  theorem  let 


h = 1.  , the  function  which  is  1 on  A and  0 on  A . If 
n A ’ n n 


n 

P (E)  = 0,  then  Theorem  1 implies  that  P (B  fl  A ) ->  P„(B  0 A I for 
0 nnoo 

all  B with  PqOB)  = 0.  To  confirm  that  this  is  enough  to  guarantee 
P (’Ia^)  =>  PQ(-| Aq)  we  use  the  following  lemma  ([20],  Cor  1,  p.  14) 
with  U = {B:PQ(dB)  = 0} . 


Lemma  2.  A sequence  of  probability  measures  converges  weakly 

to  a limit  Q if  there  is  a class  of  sets  U so  that 

(a)  U is  closed  under  finite  intersections; 

0 

(b)  for  every  xeS  and  £ > 0 there  is  a B is  U with  xeB 
(the  interior  of  B)  and  B C{y:P(x,y)  < £};  and 

(c)  Qn(B)  Q(B)  for  every  B m U. 


To  translate  P.(E)  = 0 into  a condition  on  the  sequence  A 
0 n 

c 

note  that  xeE  if  and  only  if  there  is  a k and  6 > 0 so  that 


*1 

J 


i 

a 


1 


p(x,y)  < 6 and  n 2 k implies  h n(x)  = h (y).  If  hn(x)  = 1 then 


-<-xp-*r?r 


m 


h0(x)  = hn(y) 

for  all  n ^ k 

means  ye  DA  so  in  this  case  xeEC 

. , n 
nSk 

if  and  only  if 

xe  u(  n a \° . 
k\nSk  J 

Similarly  if  h0(x)  = 0 then  xeEc 

if  and  only  if 

xe  u/  n a^\°. 

k\n&k  ) 

From  this 

we  get 

E = [u( 

0 An)°  n AolC 

-ru(DA„)°nA0 

Lk  ‘ 

n£k  / J 

Lk\rc>k  / J 

identity  I" U / 0 AC\°"]C  = f)  ( U A V 

[k  \is>k  n/  J k \r£>k  n/ 


Using  the 
algebra  converts  the  above  to 


and  a little  set 


* ■ b-  *u  (r-)0] u [c  U ft»)"  - a°] 
u fc  U a»)~  ■ *u  U A»)°] 


I 


Because  the  two  unsightly  terms  in  the  above  expression  are 
similar  to  the  ordinary  limsup  and  liminf  for  sets  we  will  introduce 
the  following  notation; 


LIMSP  A = f| 
n k 


(r-) 


LIMNF  A = u 
n k 


LnM° 


In  this  notation  the  conditions  to  be  satisfied  for  PQ(E)  = 0 are 

(a)  P (A  A LIMNF  A ) = 0 and  (b)  Pn(LIMSP  A - LIMNF  A ) = 0.  From 
0 0 n 0 n n 

From  Theorem  1 we  have  that  if  (a)  and  (b)  hold  then 

P (A  ) -»  P(LIMNF  A ) = P(LIMSP  A ) so  we  have  proved  the  following 
n n n n 

result . 
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Theorem  2.  If  P(LIMSP  A - LIMNF  A ) = 0.  P(LIMNF  A ) > 0 and 
n n ’ n 

P (A  A LIMNF  A ) = 0 then  P (A  ) ->  P(A)  and  P (-|a  ) =>  P(-|a). 

n n n n 1 n 1 

A special  case  of  Theorem  2 which  we  will  need  in  Sections  3 and  4 
is  the  following: 

Example:  Let  S = D and  A = (f:inf  f(s)  > 0}  with  t ->  t > 0. 

— n n 

sst 

n 

If  q = sup  t and  r = inf  t then 
n m n m 


LIMSP  A = D (( f :inf  f(s)  > 0})' 
n n=l  ssr 

n 


D (f:inf  f(s)  ^ 0) 
n=l  s<r 


= { f :inf  f(s)  S 0} 

s<t 


To  compute  LIMNF  A^  we  observe 


{ f ;inf  f (s)  > 0) 
s^t 


if  t s t for  some  n & m 
n 


Pi  {f:  inf  f(s)  > 0)  if  t < t for  all  n 5 m 

£ > 0 9<t-£  11 


Since  the  interior  of  the  second  set  is  the  first,  we  have 


LIMNF  A = U (f:inf  f(s)  >0}  = (f:inf  f(s)  > 0) 

n=l  s^q  s^t 


LIMSP  A - LIMNF  Ar  = (f;inf  f(s)  = 0]  :j  { TQ  = t ) 

s£  t 
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Using  Theorem  2.2  now  gives  that  we  have  convergence  whenever 
P{Tq  > t}  > 0 and  the  two  sets  in  the  last  equality  above  have 
probability  zero. 

This  result  is  sufficient  for  most,  but  not  all,  of  our  desired 

applications.  If  P{f:f  a 0]  = 1 then  P{f:inf  f(s)  = 0}  = P[T  £ t) 

s£t  0 

and  from  the  computations  above  we  see  that  Theorem  2 can  only  be 
applied  in  the  trivial  case  P(TQ>  t}  = 1.  To  obtain  our  results 
P(f:f  2 0)  = 1 and  P{TQ  > t)  e (0,1)  we  will  use  the  following. 

Theorem  3.  Let  P be  a probability  measure  and  A^  be  a 

sequence  of  events.  If  (i)  there  exist  G t A such  that  for  each  m 

m 

PQGm)  = 0 and  there  is  a It  (depending  upon  m)  so  that 

A D G for  all  n 2 k , (ii)  P =»  P and  (iii)  li^  P (A  ) s P(A) 
n m n * n n 

n 

then  P (A  ) -»  P(A)  and  P ( I A ) =»  P(  |a). 
n n n 1 n ’ 


Proof. 

By  Lemma  2 it  suffices  to  check  that  P (B  0 A ) -»  P(B  fl  A)  for 

n n 

all  B with  PQB)  = 0.  From  (i) 


lim  P(BT)  A ) 2 lim  P (B  0 Gm) 

n n — — n m 

n->«> 


Since  P(d(B  fl  G ))  s P(dB)  + PQG  ) = 0 
m m 


lim  P (B  f|  G ) = P(B  fl  G ) 

n m m 

Letting  m -»  » now  gives  lim  P (B  fl  A ) 2 P(B  fl  A)  . Since 

n n 

I»co 


ci(BC)  = ^B,  P(d(BC))  = 0 and  we  have 
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lim  P <BC  fl  A ) S P(BC  fj  A) 

n n 

n-»® 


Using  (iii)  now  gives 


lim  P (B  n A ) s lim  P (A  ) - lim  P (B  H A ) <:  P(B  0 A) 

n n n n n n 

n-*<x>  n-*»  n-*= 


which  completes  the  proof. 

Condition  (iii)  suggests  that  to  apply  this  theorem  to  examples 

we  would  like  to  construct  the  largest  A for  which  there  is  a sequence 

G TA  which  satisfies  (i) . To  do  this  we  observe  that  if  G satisfies 
m m 

(i)  then  G C fl  A and  P(5G  ) = 0 so  there  are  £ J 0 so 
m _ , , x n m m 

n^k(m) 


G = {y:{x:  p(x  y)  < £ } C fl  A } 

m m ri>k(m)  11 


has  P(UG-UG)  = 0. 

m m 
m m 

* * 

The  sets  G may  have  P(9G  ) > 0 but  this  is  no  problem.  If 
m m 

£ 

H is  any  subset,  H = (y:fx:p(x,y)  < £]  Cl  k}  and  £ < £ then 

c £ c £?  1 ^ 

C (H  2)  so  d(H  ) H 5(H  ) =0.  From  this  it  follows 

that  P(dH^ ) > 0 for  only  a countable  number  of  £ , so  we  can 

pick  another  sequence  £ ^ £ for  which  the  associ  ed  G have 

v mm  m 

P(dG*)  = 0. 
m 


From  this  construction  we  see 


A = sup  U 
£ 10  m 


(n Anfm  - ujn*B)° 

\r£m  / m yrfem  J 


= LIMNF  A 


is  the  largest  set  which  can  occur  in  (i).  Using  this  observation  we 


can  write  the  result  of  Theorem  3 in  a simpler  form. 
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Theorem  4.  If  P =»  P and  lim  P (A  ) £ P(LIMNF  A ) then 

n n n n 

n 

P (A  ) -»  P(A)  and  P (•)  A ) =>  P(‘|a). 
n n n 1 n 1 


If  A = (frinf  f(s)  > 0},  then  LIMNF  A = {fjinf  f(s)  > 0}  so  the 

n s^t  n s^t 

n 

condition  above  is  lim  P (f:inf  f(s)  > 0)  £ P{f:inf  f(s)  > 0].  The 

n n s£t  sst 

n 

reader  should  note  that  if  P(f:inf  f(s)  > 0}  = 1 (or  P(LIMNF  A ) = 1 

n 


in  Th.  4)  then  the  conditional  measures  always  converge. 


Chapter  3 


CONDITIONING  ON  T,  ■>  > n 


3 . 1 Preliminary  Results 

In  this  section  we  will  investigate  consequences  of  assumptions 
(i)  and  (ii) . Our  first  result  follows  immediately  from  the  uniform 
convergence  assumed  in  (ii) , 

Theorem  1.  If  there  is  a Markov  chain  v so  that  vr  ->/c 
n [n-J  n 

converges  to  V (in  the  sense  specified  in  (ii))  then  V has  the 

following  weak  continuity  property: 

x 

if  x -»  x,  then  V m =*  VX  . (1) 

n ’ 

This  implies,  in  particular,  that  V is  a strong  Markov  process. 


Proof. 

The  second  fact  is  a well-known  consequence  of  the  first  (see 

[2l] , Theorem  16.21).  To  prove  (1)  we  observe  that  if  x^->  x there 

is  a sequence  n,  increasing  to  0=  so  that  if  y = x,  when 
k 'n  k 

x y 

n,  s n < n,  then  lim  V = lim  V n = VX. 
k k+1  , n 

k-*=  IV*co 

The  process  which  can  arise  as  limits  in  (ii)  also  have  special 
properties  because  they  result  from  scaling  and  contracting  time  in  a 
single  Markov  process.  The  most  basic  of  these  is  the  scaling 
relationship  given  in  the  following  theorem. 


Theorem  2 . If  assumptions  (i)  and  (ii)  hold,  there  is  a 6^0 


so  that 


for  all  c > 0 VCX  = cVX(-c^)  , 


for  all  t > 0 lim  c Vc 

nt  n 

tw» 


t1^  (here,  t = lim  tm)  . (3) 
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4 


f 

k 

[t 

I 

r 

t 


w 


t 


I 


so  A,  ^ lini  c 7c  < lim  c /c  £ > „ . Since  t his  holds  for  all  A „ 

1 nt  n nt  n A 1 

c tl  j yc 

and  X *■»  with  A;  < t < this  means  lim  c 7c  = t . If  6 = 0 
A l a nt  n 

n-*» 


a similar  argument  shows  lim  cnt/cn  < t for  all  £.>0  and  this 

n-*» 

completes  the  proof. 


Remark . A function  L is  slowly  varying  if  lim  L(xt)  ^ L(t)  = 1 for 

t->® 

all  x>  0.  Using  this  notation  conclusion  (3)  can  be  written  as 
c^  = n^^L(n)  . Since  we  will  write  many  statements  like  this  in  what 
follows  we  will  use  the  letter  L to  denote  slowly  varying  functions. 
The  value  of  L(n)  is  rarely  important  for  our  arguments  and  in 
general  will  change  from  line  to  line.  Subscripts  and  other  ornaments 
will  be  attached  when  we  want  to  emphasize  that  the  slowly  varying 
function  depends  upon  the  indicated  parameters. 

If  6 > 0 we  can  rewrite  (2)  as 


d n-l/6yxn 


1/6 


(n) 


(4) 


so  (1)  and  (2)  characterize  the  processes  which  can  occur  as  limits  in 

cx  d x 

(ii).  If  6=0,  however,  (2)  becomes  V = cV  and  we  can  no 

-1  CnXn 

longer  guarantee  that  there  are  c ->  « so  that  V (n-)  converges. 
We  have  not  been  able  to  characterize  the  limits  which  can  occur  when 
6=0.  The  next  few  results  show  that  these  processes  have  some 
strange  properties. 

An  immediate  consequence  of  Theorem  1 is  the  fact  that  for  all 

c > 0 

PCX(TQ>  t)  = P* f Tq  > tcf)  . (5) 


5 

i 


M 
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If  F>  = 0 this  means  that  P y[  TQ  > t)  has  the  same  value  for  all 

y > 0 so  using  the  strong  Markov  property 

Py{T0>  s+t}  = Ey[T0>  s;  PX(s){Tq>  t}] 

= Py{TQ  > s)Py(T0  > t)  . 

Since  d(t)  = Py(TQ>  t}  is  noninci  easing , nonnegative,  and  satisfies 
«f(t+s)  = «((s)«((t)  this  means  Py{  TQ  > t)  = e ^ for  some  A £ 0 
(which  is  independent  of  y)  . 

This  shows  that  (iii)  is  always  satisfied  if  = 0.  If  > 0 , 
however,  we  are  not  so  lucky.  In  this  case  taking  c > 1 in  (5)  gives 
only  an  inequality: 

PX{ Tq  > t)  ;>  Py{TQ>  t}  when  x ;>  y > 0 (6) 

so  we  are  forced  to  take  a new  approach. 

Let  S^  = inf{t:Px{Tg>  t)  =0).  What  we  would  like  to  show  is: 

s = 00  for  each  x>  0.  From  (2),  we  have: 
x ’ 

if  c > 0 S = c5S  (7) 


so  either  all  the  S are  infinite  or  none  is. 

x 

Suppose  S^  < oo.  Using  the  strong  Markov  property 

V (T  ) 

0 = Py{T  >S)  = Ey[T  _<  T-P  y+t[T,>S-T  „}] 

1 0 y y+E.  0’  1 0 y y+E/  J 


Since  v (T  ^ y + £ and  S - T < S it  follows  from  (7)  that 
y+Z  y y+Z  y 

the  integrand  is  positive  so  P^f  T _<  T_)  = 0 for  each  P>  0. 

y+Z  0' 

y 

Since  V is  a strong  Markov  process  this  implies  V (t  A T^)  is 
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H 

j 

: I 

M 

. i 


1 1 

; < 


1.  I 

{ 

' ! 


f 


nonincreasing.  When  we  note  that  for  each  L > 0 _ 

^ a "I  ^ 


0 = Py{l’  > S ] S P{v(t)  = y,T_>  t}Py{T  > S - t)  we  have  shown: 
0 y 0 0 y 1 


if  S < Vy(t)  is  strictly  decreasing  for  t < Tq 


(8) 


~a 

1 


Having  arrived  at  a strange  conclusion  under  the  assumption 
S we  might  hope  to  continue  and  derive  a contradiction . The 

next  example  shows  that  this  is  not  possible. 


< 0.  If  S = S + X for  n £ 1 then 
n n-1  n 


Example ■ Let  X , • • • be  independent  and  identically  distributed 
random  variables  with  mean 

3.  -l/n  converges  in  the  Markov  sense  to  "uniform  motion  to  the  left 

L n-  J 

at  rate  - (see  [22],  Exercise  3.7  if  you  need  a more  precise 

description).  For  this  limit  P^fT^>  t}  = 0 if  y + gt  £ 0 so 


In  this  example  the  limit  is  degenerate  so  we  wonder:  Are  there 

nontrivial  limits  with  S < co? 

y 

We  will  show  in  Section  4 that  no  process  with  this  property 
occurs  as  a limit  for  any  of  the  examples  we  consider,  but  the  question 
of  whether  (i)  and  (ii)  are  sufficient  to  guarantee  (iii)  has  not  been 
resolved.  The  solution  of  this  problem  is  really  of  minor  importance 
for  the  applications;  it  is  usually  very  easy  to  use  (8)  to  verify  (iii). 

Up  to  this  point  we  have  only  used  the  sealing  relationship  for 
x > 0.  If  we  let  x - 0 in  (2)  and  (5)  then  wc  get  two  more  formulas 
to  help  us  analyze  the  limit  process. 


J 

•? 

1 

‘■a 

3 

i 

v \ 
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V°  2 cv°(  c6) 


P°{T0>t]  = P°{T0>tc6} 


If  6=0,  (9)  says  = cV^  for  all  c > 0 so  = 0 . 

x — 

Combining  this  result  with  the  fact  that  P { T > t)  = e for 


x > 0 gives 


lim  P sup  V^(t)  > 6|  T 

£.10  Wtsi 


0s  >) 


S e^lim  P I sup  V^(t)  >6  = 0 


£10  )(KtSl 


so  (V  | Tq  > 1)  =s  0 as  £i0 . Taking  a peak  ahead  into  Section  3.3 

we  see  that  this  means  the  only  possible  limit  of  V*  is  0 so  we  will 

abandon  this  case  and  label  it  trivial. 

If  6 > 0,  (10)  shows  that  P°(T0  > t)  has  the  same  value  for 

all  t > 0.  Since  P0{TQ  > 0)  = lim  P°{TQ  > u)  it  follows  from  the 

uiO 

Blumenthal  0-1  law  ([22],  Theorem  0.17)  that 


P (T  > t]  is  either  = 0 or  = 1 


Since  ! T^  > t]  is  open,  using  (5),  (1)  and  Theorem  1.1  gives 

PX[T  > t}  S lim  PyfT  > t)  2-  P°fT  > t]  (12) 

0 J io  0 0 

yiO 

for  all  t , x > 0 . 

0 x 

From  (12)  wc  see  that  if  P [ T^  > t)  = 1 then  P f T > t)  = 1 for 
all  t,  x > 0 and  so  we  expect  that  the  condi tioning  to  stay  positive 


will  have  no  effect,.  For  positive  levels  this  is  a consequence  of  the 
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results  uf  Chapter  2 : if  x -*  x > u usmp,  r.  2.4  mves 

n 

x 

(V  n|  N > n)  --  (VX|T0  > l)  -■  VX. 


If  x -»  0 t he  situation  becomes  more  complicated.  If 
n 

\ 

lint  P N > n]  < 1 then  we  cannot  apply  the  results  oi  Chapter  2 
n 


(each  theorem  has  P (A  ) ■■>  P(A)  as  a conclusion)  and  il 

n n 

x 

li®  P ' N > r.]  0 , V mav  fail  to  be  tight.  Conditions  for 

n n 

n 


cnnve rgence  in  this  case  will  bo  given  in  Section  3.3.  The  results 


given  there  will  show  that  if  the  limit  ex:  ,ts  in  the  sense  of  (a)  then 


+ 0 

V =»  V , it-.,  the  conditioning  has  no  effect. 


For  the  rest  oi  the  paper  we  will  be  mainly  concerned  with  what 


happens  when  PX  T - t } 3?  1 for  some  (and  hence  all)  x > 0 . Since 
pX  :r  Tg  > t)  is  decreasing  lim  P*  • T(.  > t)  exists  for  each  x > 0. 


Using  the  scaling  relationship  gives  that  this  limit  is  independent 


of  x.  Call  it  \ From  the  Markov  property 


Lo  1 1 i ng  s « 
If  A = 0 
we  can  use  (1) 


t + s] 


gives  A - • PX  •'  T > * 
this  agrees  with  our 
to  conclude 


PV«>  T 


d] 


] so  A - 0 


prev  i oils  cal  nil  a t i on  . 


1 1 A > 0 , 


1 i m P'  T : • t j 
x i 0 ° 


lim  P1;’  T > u]  - 0 ill  PX ; T()  • 1 1 / 1 . (13) 

Ul  O" 


The  reason  for  interest  in  this  conclusion  is  the  following: 


Suppose  lim  P”  T > t]  0 for  all  t • 0 and  (iv)  holds, 
xl  0 

li  lor  eacli  m PrN  > ml  v x)  is  an  increasing  function  of 
x then 

x 

(v)  P n r \ . nl  1 a 0 whenever  x -»  0 and  t -»  t > 0. 

n n n 


} (H) 
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There  is  a converse  to  this  proved  in  [41 ]: 


if  (v)  holds  then  so  does  (iv)  . (15) 

Since  it  is  usually  more  difficult  to  verify  (v)  than  (iv) , (15)  is 
not  a useful  result  for  checking  that  (iv)  holds.  To  obtain  the  results 
we  will  use  to  check  (iv)  in  Chapter  4 we  will  use  the  results  of 
Chapter  2. 


If  P { Tq  = t]  = 0 and  P (T  = 0]  = 1 then  from  the  strong 

Markov  property  P { f : Inf.  f(s)  = 0)  = 0 so  using  Theorem  2.2  gives 

OSs£t 

x 

(Vn*1)  N > nt^)  ^ (Vx|  TQ  > t)  whenever  xn  x > 0 and  t^  -*  t > 0. 
From  (9) 

P°fT"  = 0}  a lim  P(V°(t)  <0]  = P{V°(1)  < 0}  (16) 

t+0 

so  if  pV(1)  < 0}  > 0 using  the  Blumenthal  0-1  law  gives 
P f T^  = 0]  s=  1 and  the  result  above  can  be  applied  to  conclude: 

if  PXfTQ  = t)  = 0 and  PfV°(l)  < 0)  > 0,  (iv)  holds.  (17) 

On  the  other  hand,  if  P(V^(l)'<  0)  = 0 

Pf  inf  V°(s)  2 Oj  2 1 - T,  P(V°(q)  < 0]  = 1 (18) 

Chis^t  q, rational 


so  V 2 0 and  Theorem  2.2  cannot  be  applied.  In  this  case  wc  will 
use  Theorem  2.4  or  another  trick  (see  Section  4.4). 
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■ I 
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•k 

3 . 2 Conditions  for  Tightness 

According  to  Theorem  15.2  in  [20],  a sequence  of  probability 
measures  on  D is  tight  if  and  only  if  the  following  two  conditions 
hold: 

(a)  lim  lim  P {f:sup|f(t)[  > M}  =0 

n 1 1 

rno  t 

(b)  if  co^(6)  is  the  quantity  defined  by  (5)  of  Section  1.2 
then  for  each  £ > 0 

lim  lim  P^{f:u^.(6)  < £}  = 0 

5 n-»» 

Because  of  the  complexity  of  the  definition  of  ui'  the  second 
condition  is  usually  difficult  to  verify.  In  this  section  we  will 
assume  (i)-(iv)  hold  and  develop  equivalent  conditions,  which  are 
easier  to  check  in  our  special  case,  by  examining  the  behavior  of 
the  path  before  and  after  hitting  [£,“>). 

If  T-.(f)  > we  can  let  t = T_(f)  in  the  definition  of  u/ 

W 1 ^ 1 

and  obtain 

u£(6)  * f v u£(6:T  l)  (1) 

When  f = Vn  the  last  expression  is  the  "l)  modulus  of  continuity" 

of  a process  which  starts  from  a height  V'(T_A  1)  and  is  conditioned 

n c. 

to  stay  positive  for  (1-T^)  time  units.  Since  we  have  assumed  (iv), 

x 

the  results  of  Section  2 show  that  (V  "|N>  n)  (VX|  T > 1)  when 

n 1 0 

XR  -»  x > 0 and  using  t he  inequal i tv  above  we  can  prove  the  following. 

■k 

Note:  Throughout  this  section  we  will  assume  that  5,  the  exponent  in 

(2)  of  section  3.1,  is  positive. 


I 


j 

•1 

i 


] 
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Theorem  3 , V*  is  tight  if  and  only  if  the  following  two 
conditions  hold 

(3a)  for  some  £ > 0 lim  lim  P{V+(T-.)  > M}  = 0 

M-*oo  n->co  n 

(3b)  for  all  Z > 0 lim  liin  P{T  (V+)  < 6}  = 0 

6->0  n->“  n 

That  is,  we  have  tightness  if  the  conditioning  does  not  make  the 
process  jump  too  high  or  leave  zero  too  fast. 


Proof. 

The  conditions  are  necessary  since  they  follow  from  (a)  and  (b) 
above.  To  prove  sufficiency  define  the  post-T£  process 

<<•>  = <''[»<V  )l/cJTCs  *,  ">  "> 


Since  v is  a Markov  chain 
n 


X+(  ) = ( vr  ,/c  |v.  = Y , T > L ) 

n [n- J n1  0 n’  0 n 


where 


and 


Yn  = (v„T/cJTcsl'N>n) 
n n 


Ln  - <l-TdTe5  ")  • 


From  Prohorov's  theorem  ( f 2 0 ] Theorems  6.1  and  6.2)  a sequence  of 
probability  measures  on  D is  tight  if  and  only  if  every  subsequence 
has  a further  subsequence  which  converges  weakly,  so  it  is  enough  to 
show  that  for  any  subsequence  (a)  and  (b)  hold  for  some  further 
subsequence . 


!8 


Let  £>0.  If  P (Tcfi  1)  -»  0 as  k « then  (a)  and  (b) 
nk 

hold  so  it  suffices  to  consider  subsequences  for  which 


lim  P { T-.  l)  > 0.  In  this  case  the  tightness  of  Y follows  from 
n,  t.  n 


k->°°  k 


(3a).  Since  0 i L si,  (Y  ,L  ) is  tight  and  so  there  is  a 
" \ "k 

sequence  of  integers  m ~ n t * so  that  (Y  ,L  ) •»  (Y.L)  . 

.1  k . m . m . ’ 

J .1  J 

Let  h be  a bounded  continuous  function  from  I)  to  R.  If 

g (x,t)  = E(h(VX)|T  > t)  then  E(h(X+)>  = E(g  (Y  ,L  )).  Using  (iv) 
n n ‘ 0 n n n ’ n 

and  the  results  of  Section  2 we  have  that  as  x x > 0 and 

n 

t t ^ 0 
n 

gn(xn’tn)  ^ g(x’°  = E(h(V)|v(0)  = x,T0>t) 


so  from  Theorem  2.1  Eh(X+  ) Eg(Y  L)  . From  this  we  can  conclude 

mk 

+ | * 

Xm  =>  (V|V(0)  = Y,T^  > L)  , a process  we  will  denote  by  V 

k 

4.  * + * 

Since  X = V using  Theorem  1.1  gives  that  lim  Eh(X  ) 5 Eh(V  ) 
nt.  . m. 

k k k 


when  h is  bounded  and  upper  semicontinuous . Applying  this  result  with 

h(f)  = 1 A (sup  f(t)  - (M-l))+  (see  (3)  of  Section  1.2)  and 
t 

h(f)  = w^,(6)  A 1 (see  Theorem  1.2)  and  using  the  obvious  inequalities 
sup  f(t)  s E v sup  f(t) 

t teTe 

F,n^f(^)  " pn[Te<  65  + pnftof(6:Te,l)  >t!Tes  1] 


completes  the  proof. 


20 


Condition  (3a)  may  be  difficult  to  check  directly  because  it 
involves  estimating  the  value  of  V*  at  a random  time.  Using  the 
scaling  relationship  and  the  Markov  property  we  have  for  t < 1 that 

P(V(1)  > K| V(t)  = x}  = P{VX(l-t)  > K} 

= P{xV1((l-t)x"6)  > K] 

If  6 > 0 then  from  the  right  continuity  of  V1  as  x -»  °°  the 
above  converges  to  1 uniformly  for  t e[0,l]  so 

lim  PfV(l)  > K|v(Tp)  > M}  = 1 

M-joo 

From  scaling  and  the  right  continuity  of  V1 

lim  PX{T > 1)  = lim  PJ{T  > t)  = 1 

xT®  tJO 

so  the  same  statement  holds  for  the  process  V+.  This  suggests: 

Theorem  4.  A sufficient  condition  for  (3a)  is 

lim  Tim  P(V+(1)  > K}  = 0 

* n 

fc-»co  n->® 


Remark . From  (a)  it  is  clear  that  this  is  necessary  for  tightness.  An 
argument  similar  to  that  given  in  the  proof  below  will  show  that  this  is 


w 


where  q”(x,t)  - P(vn(l)  > K|Vn(l-t)  - x , TQ  > 1).  From  (iv)  and 

Theorem  1.1.  if  x -»  x > 0 and  t t S?  0 
’ n n 

lim  q"(x  , t ) S?  q(x  t) 

K n n 

n-»°o 

where  qK(x,t)  = P(V(1)  > K|v(l-t)  = x,Tq  > 1)  so  for  u :£  1 

TIT  P{V+(1)  > K]  Sr  TIT  EfV+(T_)  > 2Ku~l/6;q”(V+(T_)  ,1-T)  ] 
n u n ’ K n Z,  * E, 

rv^oo  n 

Sr  [ inf{q.,(x,s)  :x  Sr  2Ku_1//,Sj0  <;  s s l)  lim  PfV+(T  ) > 2Ku_1/^] 

K n 

n->oo 

c 

From  scaling  q (x  t)  = q (xc,tc°)  so  if  2K/x  5 1, 

K KC 

q ( x , t ) £ q (2K,t(2K/x)^)  and  from  above 
K K 

TIT  P{V+(1)  > K}  Sr  r inf  q (2K . s)l  Tim  Pi'V+(T_.)  > 2Ku'1/6) 

n I K n 

n->»  LOrSs^u  J n-y» 

Now 

V (0)  = 2K)  - P(T  S s I V (0)  = 2K) 
n 0 ^_n 

11  P(Tq  > s | /n(0)  = 2K) 

Letting  u ->  0 gives 

TIT  P{V+(1)  Sr  K]  Sr  lim  TIT  PfV+(T_)  > M} 
n „ n Z 

n-»<»  n->co 

and  letting  K -»  ® gives  the  desired  result. 

From  Theorem  5 if  we  know  that  V+(l)  converges  then  (3a)  is 

n 

satisfied.  The  next  theorem  gives  a sufficient  condition  for  (3b). 


P(V  (s)  > K 

1 S?  q„(2K  s)  Sr  ^ 


1 

* i 


• J 
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Theorem  5.  Lot  P be  the  probability  measures  induced  on 

n 

D[-l,l]  by  V+(t  v 0) . If  (3a)  holds  fpn>n  s 1)  is  tight.  If, 

+ * 
in  addition,  for  every  P which  is  the  limit  of  a subsequence  P^ 

♦ _i_  h 

we  have  P (f;f(0)  ^ f(0-)]  = 0 then  (P  n ^ 1)  is  tight. 

Proof. 

For  all  f e D[-l,l]  which  are  constant  on  [-1,0)  if  6 < 1 
we  have 

u'(6;-l,D  & Z v u^(6;T£,1) 

From  this 

P*{^(6;-1,D  >e)  * P*{w'(6;Tt,l)  >e) 

so  using  the  proof  of  Theorem  3 we  see  that  (3a)  is  sufficient  for 
tightness  in  D[-l,l]. 

To  prove  the  other  result  we  note  that  by  Prohorov's  theorem  it 

* * + + * -i 

is  sufficient  to  show  that  if  P =s  P then  P =>  P = P n where 

nk  nk 

ft  is  the  natural  projection  from  D[-l,l]  to  D[0,l].  If 

hjDfO.ll  ->  R has  P+(A,  ) = 0 where  A,  is  the  set  of  discontinuities 
L ’ J h h 

3fC  * 

of  h then  P (f:f(0)  ^ f(O-)  = 0}  implies  that  P (A^)  = 0.  The 

desired  result  now  follows  from  Billingsley's  form  of  the  continuous 

mapping  theorem  ([20],  Theorem  5.2):  P^  =»  P if  and  only  if 

pnh  * =>  Ph  1 for  each  measureable  real  valued  function  h with 

P(A,  ) = 0. 
n 

Combining  the  conclusions  of  Theorems  3,4,  and  5 gives  the  following 


result . 


r 


Theorem  6 . is  tight  if  and  only  if 

(6a)  lirn  Tim  P{V+(1)  > K}  = 0 

K+rn  n-»o> 

(6b)  lim  lim  P(V+(t)  >6}  =0  for  each  ft  > 0 . 

_ n 

t-»0  n-*» 

From  Theorem  6 if  we  know  that  the  finite  dimensional  distributions 

* * 

°f  Vn  converge  to  those  of  a process  V with  Pf V (0)  =0}  = 1, 
then  the  sequence  is  tight. 

In  Theorem  10  below  we  will  give  conditions  which  imply  that 
if  V+  is  tight  then  the  limit  is  lim  (VX|  T > 1)  (assuming  this 

n in0 

xiO 

exists)  so  in  cases  when  the  convergence  of  finite  dimensional 

distributions  is  not  known  we  would  like  to  check  that  the  sequence 

is  tight  without  computing  the  limit  of  the  distributions. 

One  way  of  doing  this  (which  we  will  use  in  Section  4.3)  is 

to  observe  that  if  V+  (t  v 0)  converges  almost  surely  (as  a 

nk 

sequence  of  random  elements  of  D[-l(l])  to  a process  V with 
* 

P{V  (0)  > 25}  = p > 0 for  some  6 > 0,  then  from  the  definition  of  the 

metric  for  1>[-I,l],  lim  P(V+  (T  ) -5  > 6}  S p.  Using  Theorem  5 and 

k nk  ' 

Lemma  2.1  now  gives: 

Theorem  7.  If  for  each  £.  > 0 (V+(T_)  - £.)  5 0 then  V 

- - . n ^ n 


i 


i 

i 


is  tight. 


3.3  Convergence  of  Finite  Dimensional  Distributions 


In  this  section  we  will  assume  V+  is  tight  and  derive 

n 

conditions  for  V*  to  converge.  Our  method  of  proof  is  not  the  usual 
one  suggested  by  the  title  of  this  section,  however.  We  will  prove 
convergence  by  showing  that  all  convergent  subsequences  have  the  same 
limit. 

The  first  step  is  to  consider  what  processes  can  occur  as  limits 

of  the  V+.  From  (i)-(iv)  and  the  results  of  Section  2,  if 
n 

x 

x -»  x > 0 (V  n|N  > n)  =»  (VX|  T.  > 1).  Letting  x go  to  zero  very 
n n 1 1 u n 

slowly  we  see  that  if  V+  converges  for  all  x -*  0 then 

n n 

lim  (VX|  T > 1)  exists  and  is  the  limit  process  for  any  x -»  0. 

xi0  x o 

Assuming  lim  (V  |T  > 1)  exists  and  writing  (V  |T > t)  for 

xiO 

lim  (VX|  T > t)  we  can  give  a simple  formula  for  the  processes  which 
xJO 

can  occur  as  limits  of  subsequences  of  V+. 

n 

4-  * 

Theorem  8.  If  V =*  V then  there  are  random  variables 

n 

* * * * 

t €[0,l]  and  x £ 0 with  P{ t ~ 0,x  > 0)  = 0 so  that 

★ 

V*()  = \'t*  <:  -}(VX  (‘"t+)lT0  > 1_t*)  (l) 

Remark.  This  characterization  shows  that  if  (V^j TQ  > 1)  =>  0 as 
0 then  0 is  the  only  possible  limit. 


Proof • 


From  the  proof  of  Theorem  3.3  V (T^(V  )+t)  behaves  like  V 

* * 

starting  from  V (T^)  and  conditioned  to  stay  positive  for  l-T^CV  ) 
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units  of  time.  As  £ decreases,  T^(V  ) does  not:  increase  so  as 

* * * 

£.  i 0,  T^(V  ) converges  to  a limit  t . Since  V is  right  contin- 

* * 
uous  this  means  V (1^)  converges  to  a limit  x . 

Under  the  hypothesis  of  Theorem  8,  (x,t)  -»  (Vxj Tq  > *-)  is  a 

continuous  function  from  [ 0 ,°=)x(0  ,°=)  to  li[  0 , 1 ] so  using  the 

* 

* * x I * 

continuous  mapping  theorem  we  see  that  V (T^(V  ) + t)  =>  (V  | T > 1-t  ) . 

* „ * * 

Since  0 <:  V < ^ on  L 0 , T^(V  ))  this  shows  V has  the  representa- 
tion given  by  (1) . 

* * 4.  * 

To  see  that  Pf  t = 0,x  > 0]  = 0 observe  that  since  V =*  V 

nk 

4-  + * ^ 

in  D,  x = V (0)  ^ V (0)  so  V (0)  = 0. 

\ "k 

It  is  easy  but  tedious  to  show  that  all  the  processes  given  by 
formula  (1)  are  possible  limits.  In  the  next  example  we  show  how  to 

ife  )|(  ijc 

do  this  if  P{  t = 0}  = 1-p  and  P{  t = t,x  <;  x]  = pF(x)  where 
p,t  e(0,l]  and  F is  a distribution  with  F(O-)  = 0.  We  leave  the 
general  construction  to  the  reader's  imagination. 

Example.  Let  v^  be  an  integer  valued  Markov  chain  (say, 

-f  + 

a Bernoulli  random  walk)  with  satisfies  (i)-(iv)  and  has  V =>  V 

n 

for  all  x 0. 
n 

Let  fr  .,0  ^ i < j < m]  be  a collection  of  distinct  numbers 
i J 

taken  from  (0,1)  and  let  A^0-  Lot  be  tlle  Markov  chain  defined 

on  5Z  U { r . . ,0  . i s j < oo)  which  makes  the  same  transitions  on  the 
integers  as  v^  and  is  defined  on  the  other  states  by  the  following 
rules 
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if  i = 0 


if  i = [jt]-l 


P{v' 

= 1 

1 vo  = 

•o.ji 

] -p 

P{v' 

= rl,j 

K = 

ro.j> 

= p 

P{v' 

= 0 

lv0  = 

riJ ! 

= 1- A . 

.1 

P(v' 

= ri+l, 

^r°= 

1 

= Ai 

P(v' 

= 0 

K = 

ru  > 

= 1-A 

J 

P[v^ 

= e . 

h,  j 

lv0  = 

hj 1 

= Vhj 

where  for  each  j,  h ^ 1 is  an  increasing  sequence  of  positive 

integers  and  h ^ 1 is  a nonnegative  sequence  with 

E p,  .=1  so  that  if 
tel  h’J 

F (t)  = E P,, 

3 h e £c  t hJ 

’ hj  n 


then  F . =>  F as  i -»  oo. 
J 


Having  identified  the  possible  limits  of  subsequences  of 
x 

<\  lTo>  l>  the  next  step  in  solving  problem  (a)  is  to  determine  for 

* Xn  * 

which  V there  is  a Markov  chain  v^  so  that  (V  ! T > 1)  =»  V for 

all  x -»  0. 
n 

x 

If  lim  P (N  > n}  > 0 for  some  x -»  0 then  it  is  easv  to  show 
r n n 

that  a subsequence  of  V+  converges  to  V so  in  this  case  if  the 


convergence  takes  place  in  the  sense  of  (a)  the  conditioning  will  have 
no  effect. 
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To  characterize  the  limits 


which  can  occur  when  (v)  holds  we 


will  investigate  the  convergence  in  the  case  xncn  — a-  In  this 

instance  the  limit  process  results  from  conditioning  and  scaling  a 

single  sequence  of  random  variables  so  there  is  a scaling  relationship 

* 

which  allows  us  to  compute  the  distribution  of  V from  that  of 


Theorem  9 . Let:  xncn  = a,  Qa  ( • ) - P(  • ! vQ  = a)  . If 

+ 

V (1)  ^ 0 then  converges  to  a process  which  is  =0.  If 

+ * , * o 

V (1)  v with  Pl  v - 0}  < 1 then  Q fN  > n'  - n “ L fn) . In  the 

n a 

second  case  if  (v)  holds  then  the  finite  dimensional  distributions 
of  i 0 < s £ 1}  converge  to  those  of  a nonhomogeneous  Markov 

process  V+  which  has 

P(V+ (t)edy)  = t_pP(tYv*edy)Py{TQ  > l-tl  (2) 


P(V  (t-s)edy,T  > t-s)Py{T  > 1-t] 

P(V  ( t)e dy|  V (s)  = x)  = 

PX|Tq  > 1 -si 

for  x > 0 . (3) 

II  V+(t)  0 as  t 0 then  V+  is  tight  and  V*  ~ V+  . 

n n n 

Proi  < f . 

* 

The  first  result  is  obvious:  observe  that  if  V is  given  by  (1) 
then  P(V*  ( t t s)  > 0| V*( t)  = x)  = P(V'X(s)  > 0|  Tfl  > 1-t)  ■=  1 so  V* 
does  no>  hit  zero  after  it  hits  a positive  level. 

To  prove  the  second  statement  note  that  if  \ ,•  0 


1 


i 


i 


n 


Q (N  > (l+\)n) 
Qa(N  > n} 


j Qd(V  (l)edx|N  > n)P(N  > Xn| v = xc^)  (4) 

(0,®) 


and  from  the  hypothesis  as  x ->  x s 0 ^ (x  ) = P(N  > \nlv  = x c ) 

n n n ' 0 n n 

x X. 

converges  to  P [T^  > X}  = <&  (x)  . 

iK(y.')  > 0 for  x > 0 so  if  V+  ( 1)  =>  v with  Pfv  = 0}  < 1 

n 

then  from  Theorem  2.1  QS(N  > (l+X)n]/Qa{N  > nl  converges  to  a 
positive  limit.  If  we  let  p(l+X)  denote  the  value  of  this  limit 

then  since  p(st)  = p(s)p(t),  p is  measureable,  and  p(s)  £ 1 for 

“ft 

s s 1 we  can  conclude  p(s)  = s for  some  g 2:  0. 

This  shows  that  Qa(N  > n]  has  the  indicated  form.  To  prove 
that  the  finite  dimensional  distributions  of  V*  converge  we  will 
use  this  fact  and  the  following  formula: 

If  k£l,0<t...<tsl  and  y . . . y are  positive 

-L  K JL  K 


PfV+(t  ' sy.  ...  V+(t,  ) s y.  } 
n i 1 nk  k 


Q (N  > nt  ) t 

f Q"  (CV  (l)edxlN  > nt  >4'  (x) 

a,„  , , -i  1 nt,  In 

Q {N  > n]  (O^J  1 


(5) 


where 

V = P(Vn(t2}  * V 'W  * yk’  infVS>  > °lVn(ti)  = x) 

t^SsSl 

From  (iv)  and  the  results  of  Chapter  2 if  x ->  x > 0 

n 

t t 

* (x  ) -*  t l(x)  = P(V(t_)  £ yof...V(t,  ) s:  y,  f inf  V(s)  > 0| V(t  )=x) 

nn  22’  k k ' '1 

t^£sSl 

whenever  the  y.  are  all  continuity  points  of  the  distributions  of  the 
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t 


r 


< 


,1 


* 

V(t  ),  so  if  we  can  show  P{*-  = 0)  = 0 we  can  use  Theorem  2.1  to 
conclude 

P(V+(t  ) £ y . . .V+(t  ) rS  y ) -»  t " f P(t^v  cdx)'if  (x) 
n 1 Ink  k 1 . J 1 t 

(O.yjJ  l 

which  shows  the  limit  process  has  the  indicated  form. 

Let  G (x)  = PjV+(t)  S xt,  G(x)  = P{ v £ x) . From  (iv)  and 
n n ’ 

'fheorem  2 . 1 

) 

f G (d x)fS^  (x)  ->  P G(dx)e<\x) 

(0,«)  "k  \ [0  ») 

Since  QS{N  > (l+\)n)/Qa[N  > n)  ->  (1+X)  ^ using  (3)  gives 

(1+\)"P  = P G(dx)rfX(x) 

(0>) 

Now  (v)  implies  0)  = 0 and  we  always  have  si  so  this 

means  that  G(0)  s 1-(1+X)  ’ for  all  \ > 0 or  G(0)  = 0. 

To  complete  the  proof  of  Theorem  9,  we  observe  that  the  last 

statement  is  an  immediate  consequence  of  Theorems  3.4  and  3.5. 

Combining  the  results  of  Theorems  8 and  9 we  observe  that  if  (i)- 

(v)  hold  and  converges  in  the  sense  specified  by  problem  (a) 

then  the  limit  is  either  = 0 or  > 0 at  each  t > 0 so  there  are 

only  two  possible  limits  (assuming  1 im  (V ' | Tf)  > 1)  exists) 

x-*0 

At  this  point  we  are  ready  to  consider  conditions  for  convergence 
to  each  of  these  limits  but  there  is  not  really  much  to  say.  The 
next  result,  which  suirunari7.es  our  main  conclusions  is  an  easy  consequence 
of  Theorems  8 and  9. 
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be  a Markov  chain  for  which  (i)-(iv)  hold. 


i 


Theorem  10.  Let  v 
n 

■4" 

Let  x -»  0 and  suppose  V is  tight.  V > 0 if  and  only  if 
n n n 


) max  V ( 
\ n 

{(Kssa 


(s)  > Z > -»  0 for  all  £.  > 0 


(6) 


If  V+  = lim  (V*|  T.  > 1)  exists  and  is  ^ 0 then  V+  V+  if  and 
0 n 

x->0 

only  if 


lim  lim  PfV  (t)  > g]  = 1 for  all  t > 0 

gl  0 n-*» 


(7) 


If  x c = a and  (v)  holds  then  condition  (7)  is  equivalent  to 
n n 

Qa(N  > n]  = n~^L  (n) . 

a 

Proof. 

The  first  result  is  trivial.  To  prove  the  last  two  it  is 
sufficient  to  show  that  the  condition  given  in  each  case  is 
equivalent  to  assuming  that  for  all  subsequent! al  limits  V* 

PfV  (t)  > 0}  = 1 for  all  t > 0.  For  the  second  result  this 
claim  is  obvious.  For  the  third  it  follows  from  the  last  computations 
in  the  proof  of  Theorem  9. 
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Chapter  4 


EXAMPLES  AND  EXTENSIONS 


4 . 1 Random  Walks 

If  X ,X  . . . is  a sequence  of  independent  and  identically 

distributed  random  variables,  S = S ,+  X , n ^ 1 defines  a 

’ n n-1  n’ 

random  walk.  Necessary  and  sufficient  conditions  for  the  convergence 

of  (S  - b )/a  are  known  (cf.  j 29],  Chapter  7).  In  this  section 
n n n L 

we  will  use  some  of  these  results  to  show  that  if  S /a  converges 

n n ° 

in  distribution  to  G then  (i)-(iv)  hold  and  the  results  of 
Chapter  3 can  be  applied  to  prove  the  appropriate  conditioned  limit 
theorems . 


Theorem  1 . For  the  nondegenerate  distribution  G to  be  the 

limit  of  some  sequence  of  normalized  sums  (S  -b  )/a  it  is 

n n n 

necessary  and  sufficient  that  it  be  stable,  that  is,  if  X,X  , ...Xj^ 

are  independent  and  have  distribution  G then  there  are  constants 

a!  > 0 and  b,'  such  that 
k k 

X1  + ' ' • + \ * 3kX  + bk 

10  X 

Theorem  2.  d(Q)  = Ee*  is  the  characteristic  function  oi  a 
stable  law  if  and  only  if 

log  ef(v)  = ik0  - c|ela[l  + biu  _(6)6/|e|]  9^9  (1) 


where  0 < G£  £ 2,  -1  i bi  1,  c s 0 and 


tan(rtCt/2) 


if  0/1 


Uja(e) 


(2/n)  log  1 9 I if  Of  --  1 
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BW.1U  JUWy 


The  centering  constants  can  be  chosen  to  be 


t 

i 

■ 

1 

\ 


nEX1 

if 

nE(-a  VXAa  ) 

if 

n n 

0 

if 

1 < a S 2 

a = 1 (see  [24] , p.  315) 
0 < a < 1 


From  Theorem  3 it  is  immediate  that  if  = 0 and 

(S  -b  )/a  =>  Y then  the  finite  dimensional  distributions  of 

n n n 

V (t)  = (Sr  ,-i-  br  .)/a  converge.  Skorohod  has  shown  (Theorem  2.7 
n [ n t J ^ 

in  [32])  that  there  is  also  weak  convergence. 


Theorem  4.  If  S is  a random  walk  and  (S  -b  )/a  =»  Y 

n n n n 

(nondegenerate)  then  Vr  =5  V a process  with  stationary  independent 

increments  which  has  V^(l)  = Y. 

If  lim  b /a  = u (finite)  the  centering  is  unnecessary  and 
n n 

rw» 

S /a  satisfies  (i)-(ii) . 
n n 

The  next  step  is  to  check  that  (iii)  holds.  To  do  this  we 
observe  that  if  Py(TQ  > t]  = 0 for  some  positive  y then  from  (8) 
of  Section  3.1,  (VX(t),t  < T j is  decreasing.  Since  V has  independent 
increments  this  means  [V  (t),t  2 0}  is  decreasing  and  so 

P[Vy(t)  SO)  =1. 

Conditions  for  stable  processes  to  have  this  property  are  well- 
known.  Using  results  from  [28]  we  see  that  if  Py(T^  > t]  = 0 then 
0 < a < 1 , b = -1 , and  \ < 0 in  (1) . To  complete  the  proof  we  will 
use  the  scaling  relationship  to  show  that  none  of  these  processes  can 
occur  as  limits  in  (ii). 


J 
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f 


f- 


Let  2^(0)  = E exp(ifiV^(t) ) . Since  has  stationary  independent 

increments  *^(0)  = *^(0)*.  From  scaling  V°(t)  = t'y'v°(l)  so 
<*t(0)  = ^(^0)  . Using  t log  ^(9)  = log  ^(t^e)  in  (1)  gives 

For  limits  of  S /a  , X = 0 if  o?  / 1 and  b = 0 if  a = 1 (2) 

n n 

Since  these  conditions  are  incompatible  with  the  ones  given  above  we 
have  shown  that  (iii)  holds. 

To  prove  that  (iv)  holds  we  start  by  observing  that  stable  laws 
have  continuous  distributions  ([29],  p.  183)  so 

PX{T0=  t)  <:  P{VX(t)  =0}  =0.  If  P[V°(1)  < 0}  > 0 then  the  results 
of  Section  3.1  can  be  applied  to  give  (iv) . If  P{V°(1)  s 0]  = 1 then 
PX[Tq  > t}  = 1 for  all  x > 0 and  (iv)  follows  from  remarks  Bfter 
Theorem  2.4. 

Using  (14)  of  Section  3.1  we  see  that  (v)  is  satisfied  in  the 
first  case  but  not  in  the  second.  Having  established  that  (i)-(v) 
hold  when  V is  not  increasing,  the  next  step  is  to  give  conditions 
for  the  sequence  to  be  tight. 

n* 

Theorem  5.  If  X.  has  a distribution  F so  that  F (c  ) =*  G, 
1 n 

a stable  law  with  G(0)  < 1 then  V+  is  tight  for  x = 0. 

n n 

Remark . If  G(0)  =1,  V is  decreasing  so  (V^| T^  > 1)  £t  and 

c 

(V  j Tq  > 1)  =»  0 as  £i0.  From  the  Remark  after  Theorem  3.8,  we  see 
that  0 is  the  only  possible  limit  in  this  case. 

Proof. 

The  proof  will  be  given  in  three  lemmas,  each  of  which  assumes  the 
hypothesis  of  Theorem  5 and  uses  the  notation  of  Theorem  3.9. 


»•  i 


4 


r 
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Lemma  1 . If  G(0)  = p < 1 then  Q°(N  > n]  = n'^L(n) . 


Proof. 

Since  stable  laws  have  continuous  distributions 

lim  Q^fS  > 01  = 1-p.  By  a formula  due  to  Spitzer  ([33},  p.  330)  if 
k^>  k 

S is  a random  walk  then 
k 


E Q°[N  > n]  tn  = exp  ( E ~ P(S  > 0}\ 

n .-=0  \k=l  K / 


Writing  9(t)  for  the  generating  function  of  Q [N  > n]  and  factoring 
the  right  hand  side  gives 


(co  k \ 

E ~~  (P(sk  > o]  - a-p))j 

/ “ tk  \ 

Now  L(l/l-t)  = exp  I -E  — a I is  slowly  varying  whenever  lim  0 

\k=l  / k->® 


(for  a proof  see  [15],  p.  1159)  so  applying  a Tauberian  theorem 

([24],  p.  447)  gives 
n 

E P(N  > m]  = n ' L(n) 
m=l 

Since  P(N  > m]  is  a decreasing  function  of  m,  applying  a generaliza- 
tion of  Landau's  theorem  ([24],  p.  446)  gives 

1 n 

lim  PfN  > n]/  - E p(N  > k]  = 1 -p 


if  p < 1 , PfN  > n]  = n L(n) . 
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Lemma  2 . Condition  (3a)  of  Theorem  3.3  is  satisfied  whenever 

the  limit  process  has  P{V  (1)  > 0]  > 0.  If  a = 2 ( we  have  in 

addition  that  (V+(T<-)-  £)+  =»  0 so  tightness  follows  from  Theorem  3.7. 
n t 


Proof . 

Let  X = s "S  , • Let  iy  = inff isn:X  /c  > yj , with  ly  = 
i i i-1  n in  n 

if  the  set  is  empty. 

n 

P( N > n,ly  < ml  £ L PfN  > i-1 ! IY  = i]Pfiy  = i] 
n . , 1 n n 

1=1 


Given  I'  = i,  X ,...X  , are  independent  and  have  common  distribution 

n ’ 1 l-l 

function  H^(x)  = (F(x)/F(ycn))A  1.  Now  H^(x)  £ F(x)  for  all  x so 

if  U ,U  . . .U  are  independent  random  variables  each  with  a uniform 
1 2 i — l 

distribution  on  (0,1)  then 


d , -1 


<(Xl’---Xi-l)lIn  = 15  = (H  (U4.i)) 


5 (F'1(U1),...F-1(U._l))  ^ (Xj.-.-.X^) 


where  the  equalities  are  between  distributions  and  the  inequality  holds 

) 

almost  surely.  From  this  it  is  clear  that  PfN  > i-ll iy  = i)  £ PfN  > i-l} 
Using  this  in  the  first  inequality  we  get 

Pf  IY  < ®|  N > n)  £ Tj  p-^  — Pf  I7  = i} 
n 1 PfN  > n]  n 

Now  PfN  > n)  = n-l3L(n)  and  Pf  iy  = i}  £ PfX^  > yc^l  so 


Pf  V < OB  N > n} 
n ' 


T,  i ' L(n) 
i=l 

n(n  1 L(n) 


n ( 1 - F ( yc  )) 
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u(x)  = [ x+l]~^L([ x+l])  is  regularly  varying  with  exponent  > -1 , so 
from  Karamata's  theorem 


2 i ^L(n)  j*  u(x) dx 
i=l  _ 0 


n(n  pL(n)) 


nu(n) 


1/1-0 


From  Theorem  3 if  0 < a < 2 


u*  i-r55!fej  = 


and  lim  nfl-F(c  y)+F(-c  y)]  = cy  so  in  this  case 

L n n 

rv>«j 

lim  Pfly  <”|N>  n)  <:  pcy^/d-p).  From  this  we  get 
n 1 

rvy» 

lim  Tim  P(V+(T£)  > y+ £ ] £ lim  lim  Pf iy  < »|  N > n} 
y_)0o  n->o°  n y*»  n->“ 


so  (3a)  is  satisfied  for  0 < a < 2. 

To  prove  the  result  for  a = 2 we  observe  that  from  above 


lim  Pfiy<oo|N>  n)  <:  2 lim  n(l-F(yc  )) 


so  using  Theorem  3 gives  (V*(T£)  -£)+  =»  0 and  applying  Theorem  3.7 
gives  that  the  sequence  is  tight  when  a - 2. 

To  complete  the  tightness  proof  when  0 < a < 2 we  use  Theorem  3.5 

and  the  following. 
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Lemma  3.  lim  lim  P(V  (u)  > y]  = 0. 

n 

u|0  n-** 


Proof . 


If  k = n-[nst]  then 
n 1 J 


P{V  (st)  > y,N  > n] 


y,°°)  ' n 


> sntlP(N>  kn(  vq-  xc^) 


If  m = nt  - [nst]  we  have 
n L J 


{><>[ 


■ft* 


> snt]P(N  > m I v = xc  ) 
/ n 0 n 


P{N  > nt] 


Using  the  last  two  equations  gives 


’">*>  > ” - S&HF  J/M  v-(f^H 


P(N>kn|  v0=xcn) 

P(Jfc>m  I v„=xc  ) 
n1  0 n 


P(N  > nt]  „ ( Cnt  „+  jsnt  \ „ ..  \ 

m>~Y  P j ~ Vnt\RfT)  >yi 


From  Lemma  and  Theorem  3.5,  V is  tight  in  U[-l,l]  so  for  any 

subsequence  there  is  a further  subsequence  with  V*  =»  V in 

k 

* * 

Since  for  any  s iO  we  can  pick  a t < 1 with  P V (s  t)  ^ V (s  t~) 
m 'mm 

for  some  m il]  = 0 the  above  gives  (for  appropriate  values  of  y) 


lim  lim  P{V  (u)  > y] 
n i 0 n->= 


t ^ lim  P(t1/'V  (st)  > y) 
si  0 


= t fV{V*(0)  > yt  1/U  ] 
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♦ — ■ 2 i 

Since  P(V  (0)  > z]  ^ lim  P( I < ®J N > n}  using  an  inequality  from  the 

n-po 

proof  of  Lemma  2 gives 

t ~pJP{V*(0)  > yt~l/a]  <:  pcy^t1_P 


and  we  can  complete  the  proof  by  letting  tJO. 

At  this  point  we  hav'e  given  conditions  for  to  be  tight  and 

Q^{N  > n)  to  be  regularly  varying  so  from  Theorem  3.10  to  prove  the 

conditional  limit  theorem  in  the  case  G(0)e(0,l)  it  only  remains  to 

show  lim  (VX|  T > 1)  exists. 
xiO 

Theorem  6.  If  V is  a stable  process  which  can  occur  as  a limit 

in  (ii)  then  lim  (VX| T > 1)  exists. 
xiO 

Proof 

If  V is  decreasing  or  P { > 1}  = 1 then  the  result  is  trivial 

s',  for  what  follows  we  will  assume  P { > t)  ^ 1 and  hence 

PX'T  > x)l0  as  xiO. 

p 

Let  R = 0 and  for  k s 0 


R._  . = inf { t > R£:V°(t+R^)  - V°(t)  *;  - £) 


Since  V°  has  independent  increments  R£+^-  R^ , k S 0 are  independent 

and  identically  distributed.  Since  P(R£  £ t]  = P£{  s t}  ->  1 as 

t a>  each  R^  < ® P°  almost  surely. 

Let  Kc  = inf(k  il  :R£  - R£  _ > l]  . From(iii),  P(R£>1}  = 
o k k-i  1 

c 0 

P^-fT  > lj  > 0 so  Mr  and  Sp  = R are  finite  P almost  surely. 

o Ke 

Let  U£(t)  = £+  [V°(S£  + t)  - V°(S£)].  Since  V has  independent 
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* I 

n 


■ i 


increments  it  follows  from  the  construction  that  (V^"|  T > 1) 


(see  Lemma  i of  Section  4.3  for  a detailed  proof  of  a similar 


result).  To  show  that  (V*")  > 1)  converges  weakly  as  £10  we  will 


P £ 0 

show  S and  U converge  P almost  surely. 


0 


Let  m(t)  = inf  V (s) . Let  S = inf(t:m(t)  =m(t+l)).  Since 
(Ks£t 


we  have  assumed  is  not  decreasing  P(V°(t)  = m(t))  < 1 and 


it  follows  from  (iii)  that  P {S  < “>}  = 1. 


Lemma  1 . lim  S ^ S 
U0 


almost  surelv. 


Proof . 


Suppose  S -»  t «-*  « . By  choosing  a subsequence  we  can  guarantee 


that  either  S St  for  all  m or  S < t for  all  m.  If  S it, 

0 £>i 


it  follows  from  the  right  continuity  of  V and  the  definition  of  S 
that  m(t)  = m(t+l)  so  S s t. 


To  prove  S ^ t in  the  second  case  observe  that  if  5 > 0 and 


t - s < 6 


- £ 5 inf  V°(S£m  + s)  - V°(sS 


<Ks£l 


<,  T ini 
[_(Ks<l- 


v°(t+s)j  - v°(sS 


inf 

.O'tS'l 


inf  V°(t+s)l  - V°(t~) 


-fi  J 


so  m(t)  = m(t+l-(5)  for  all  6^0. 


0. 


To  conclude  m(t)  = m(trl)  it  suffices  to  show  V (t+1)  = 


max  (S  + 1)  is  an  increasing 
ls>m?,n 


1 


■r 


so 


( ( t+1 ) -)  . To  do  this  we  observe 


sequence  of  stopping  times  which  are  less  than  t+1  so  the  desired 


f | 

ij 

[ ! 
>.  j 


V 


I 


conclusion  follows  from  the"quasi  left  cont inuitv'of  V (see  [22], 
p.  45  and  Exercise  1.9.14). 

£ 0 

Lemma  2 . lim  S £ S P almost  surely. 

EiO 

Proof . 

Let  X = m(S) . The  first  step  is  to  show  X = V°(S-)  P°  almost 
surely.  To  do  this  we  observe: 

(a)  If  T is  a positive  random  variable  and  6 > 0 then  there 

is  a stopping  time  Q.  so  that  P(Q.  ^ T,V°(T-)  > V°(T))  £ g and 

0 0 

(b)  if  Q is  a stopping  time  and  P°{TQ  = 0]  = 1 then 

Pi  inf  f (s ) = f (Q)  \ = 0 so  P(SrrQ)  = 0. 

(Q£s£Q+1  • 


Now  R£ 

k+1 

is 

the 

first  time  m(t)  - m(R^)  < - £ 

K 

so  we  have 

for  all 

£ there  is  a 

Ke 

so 

that  V0(RL)efx  -£  ,Xj.  Since 

Ke 

X££ 

this 

E 

shows  lim  S £ 
El  0 

s 

p° 

almost  surely. 

Having  shown 

s£. 

-»  S , to  show  -»  U = V^(s+t), 

we  need 

to  prove 

V (S)  = V (S-) . Although  this  is  obvious  the  details  are  tedious  to 
write  out  so  we  will  refer  the  reader  to  Lemma  3.2  of  [ 31 ] to  complete 
the  proof. 

Remark . Although  this  completes  the  proof  of  the  conditioned  limit 
theorem  in  the  case  G(0)e(0,l),  our  solution  is  still  somewhat  incom- 
plete because  we  have  not  given  the  distribution  of  the  limit.  If  V is 
Brownian  motion  the  formulas  can  be  found  in  [26].  If  V is  a stable 
process,  however,  the  distribution  of  the  limit  is  known  only  in  one 
special  case  (see  Section  4.5). 


i 

j 


i 
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4 . 2 Branching  Process 


Vr 

[' 

s 

N 

S i 


f 

fr 

| 


11 


Let  zn>n  s 0 denote  the  number  of  particles  in  the  n^  genera- 
tion of  a Galton  Watson  process  with  z^  - 1 and  particle  production 
governed  by  the  probability  distribution  { jj  i=0 ,1 ,2 . . . ) . (For  a 

detailed  definition  consult  the  first  few  pages  of  [34]  or  [35].) 

00 

Let  f(s)  = 72  P . s be  the  generating  function  of  z and  for  each 


i=0 

n S 2 let  f (s)  = f(f  ,(s))  be  the  generating  function  of  z . 

n n-1  n 

Kesten,  Ney,  and  Spitzer  ([34],  p.  19)  have  shown  that 

2 

Theorem  1 . If  Ez^  = 1 and  ECz^-l)  = 2\r  (0  ,c°)  then 


, . 1 
lxm  - 
n 

rvyo 


‘-Vs> 


1 

1 — s 


X 


(1) 


uniformly  for  0 i s < 1. 

Setting  s = 0 in  (1)  and  noting  that  P[zn>  0]  = l-f^CO)  we 
obtain  the  following  formula  for  P(z^  > 0] • 

Theorem  2.  As  n -»  <*>  Pr  z > 0)  ~ (nX)  (2) 

— n 

Another  immediate  consequence  of  Theorem  1 is  the  following 
conditioned  limit  theorem. 

Theorem  3.  1 im  P{ z /n  X > x|  z > 0]  = e (3) 

n 1 n 

n-*c° 

Proo  f . 

-0:z  /nX 

E e n I z > 0) 

1 n 

-az  /n\ 

= E(e  ” ; z > 0)/E(l;z  > 0) 

n n 


f)2 


I 

f- 


= (fn(e  Lr/  ) - fn(0)>/(l  - fn(0)) 


= 1 - (1  - f (e“°/nS)/(l  - f (0)) 

n n 


From  (1)  lim  [ ) ] * = X + lim  [n(l-c  0/  ” )]  1 ami  from 

U-»°°  tV^cc 

(2)  lim  n ( 1-f  (0))  = 1/x  so 
n 

n_,co 

-Oz  /n\ 

] im  (e  n I z > 0)  1 - (i,  (l*-  — )>  l/;+l 

1 n 

1V>°° 


which  completes  the  proof. 


Using  the  last  two  results  ...  mpi,;.  : i..  limit  >t 

vz  /nXI  z.=  y \n)  . Since  tin  ■ am  > t<  t i . u n i.  i.-pt.i v, 

n 1 0 n ' n ■ ’ 

we  have  from  Theorem  2 that  if  y > v u > ».<•?,  (1nr»«  v oj  ancestors 

n 

which  have  offspring  alive  at  t imc  r t<  nd-  to  h.,-..  t . i sst-n  distri- 
bution with  mean  v . Using  The'. rein  3 r.ov.  givr  , t ha  • i f v -*  y a 0 

1 im 

n->co 


Using  the  Markov  property  and  Theorem  2.1  it  is  easy  to  compute  that  the 

y 

finite  dimensional  distributions  of  Z - (z.-  -|/n\|z  = y \n)  converge 

n L n • J 1 0 ' n 

(a  result  due  to  Lamperti  [36],  Theorem  2.5).  In  [37],  Lindvaal  has 
shown  that  the  sequence  is  tight  so  we  have  the  following. 


Theorem  1 . If  y^  ->  y ^ 0 then  Z^n  =»  (z[z(0)  = y)  where  Z is 
a nonnegative  diffusion  with  transition  probabilities  satisfying 
" d ‘V  P(Z(  t+s)edyj  Z(s)  = x)  = exp(-xCf/l+ott) 


-0/7.  /n\ 

E(c  n I z = v \n) 
1 0 "n 


-y  v 


k -0 


y 

FT 


( 1.4  ) 


xp(  v/lKl) 
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From  Theorem  3.9  we  have  that  the  I ini  t < rl  imep.-.  i ■ <nnl  distributions 

■f" 

ef  Z converge.  To  obtain  t.he  f.  rmulas  given  above  from  those  in 
Section  3.3  use  (3) , (31 . and  (6)  of  this  see' ion  anti  rote  that  from 
the  discussion  following  Thee  rum  3 


To  prove  that  the  sequence  is  tight  wo  have  to  check  that  for  the 
distributions  given  above  Z (t)  =*  0 .is  t -»  0.  To  do  this  we 
observe  that  if  y > 0 anil  t.  -»  0 then 


P(Z  (t)  > y) 


-2  -x/t 
t v dx 


-1  -v/l 
t e " 


4 . 3 Birth  and  Death  Processes 

Yfc  will  call  an  integer  valued  Markov  process  {U(t),t  ^ 0) 
a birth  and  death  process  if  starting  from  state  j , U remains  there 
for  a random  length  of  time  having  an  exponential  distribution  with 
mean  (^j+Uj)  ^ and  uPon  leaving  j,  U moves  to  states  j-1 

and  j+1  with  probabilities  u.(\.+u.)  1 and  \.(X.+u.) 

3 3 3 3 3 3 

respectively . 

It  is  easy  to  see  that  if  a birth  and  death  process  satisfies  (ii) 
then  the  limit  is  a strong  Markov  process  with  continuous  paths,  or 
a diffusion.  In  [4l],  Stone  has  identified  which  diffusions  can  occur 
as  limits  in  (ii)  and  given  necessary  and  sufficient  conditions  for  the 
convergence  of  birth  and  death  processes  to  these  limits. 

As  the  reader  can  imagine  these  conditions  arc  different  when 
the  state  space  of  the  limit,  process  is  (-ct>,co)  and  [ 0 ,»)  and  in 
the  latter  case  also  depend  upon  the  nature  of  the  boundary  at  0.  To 
keep  things  simple  we  will  give  the  results  first  in  the  case  the  state 
space  is  (-o°,°=)  and  the  diffusion  is  regular  and  then  consider  the 
other  possibilities. 


Definition.  Let  r = infft  ^ 0:V(t)  = x}  . A diffusion  V with 
x 

state  space  (-00,05)  is  regular  if  PX{  r < <»}  > 0 for  all  x,y. 

Theorem  1 ■ ([4l],  pp . 51-58)  A necessary  and  sufficient  condition 

that  there  exist  a stric  tly  increasing  sequence  c^  such  that  as  n 00 


L'(n’)/c  converges  (in  the  sense  of  (ii))  to  a regular  diffusion  on 

(-on  05)  is  that  the  sequence  defined  by  « •-  n ,/u  , n,=  1 

1 J n n-1  n-1  a 1 


-1  ^ 1'2  ^ 

satisfy  (\  n ) = n L,  (n)  and  jt  = n L„(n)  where-  the 

n n 1 n 2 

a.  > 0 and  the  L.  have  lim  L.  (xy)/L.  (y)  = 1 for  all  x>  0 and 

y-*° 

lim  L.(-x)/L.(x)  = d.e(0  co). 

i i i ’ 

x->“>  i //  \ 

1/(01  +G2) 

In  this  case  c = n L(n)  and  the  limit  process  is  a 

n 

diffusion  with  scale  J and  speed  measure  is  given  by 


x Sr  0 


m(x)  = 


-d  A|  x|  x < 0 


x ^ 0 


-d2Bj  x|  x < 0 


where  A and  B are  positive  constants. 

Note:  To  work  with  this  theorem  we  will  have  to  use  some  facts 

about  the  speed  and  scale  measures  of  diffusions.  A complete  discussion 

of  this  topic  is  given  in  [38],  but  very  little  of  the  information  given 

there  is  needed  to  prove  our  conditioned  limit  theorems.  A readable 

summary  of  the  results  we  will  need  is  given  in  Section  4 of  [39], 

To  show  that  (iii)  holds  we  observe  that  if  { T > t]  > 0 then 

from  (8)  of  Section  3.1,  Vy(t  A T ) is  decreasing  for  each  t>  0. 

Since  V has  continuous  paths  and  the  strong  Markov  property  this 

implies  Pyf r < ®]  = 0 for  z > y which  contradicts  the  assumed 
' z 

regular i ty . 


To  prove  (iv)  we  will  use  (17)  of  Section  3.1.  Since  V is 


f>7 


■ i 

!' 


M 
~ I 

h 

s.  { 

n 

• i 

; , 

i < 


i 

i 


regular,  V^*  j(  0 and  it  follows  from  the  scaling  relationship  that 
P{V°(1)  > 0}=0.  To  establish  thatpx{TQ  = t)  = 0 wo  recall  that 
I to  and  McKean  (see  Section  4.11  of  [38])  have  shown  that  the  transition 
functions  of  a diffusion  have  densities  with  respect  to  the  speed 
measure  so 

PX[T  = t]  ::  PfVX(t)  = 0]  m({  0}  ) = 0 

Since  V is  regular  PX[T  > t)  ^ 1 and  from  (13)  it  follows 

that  lim  PX(T0  > t]  = 0 for  all  t > 0.  Since  P{N  > m|  v = x}  is 
xiO  ° 

an  increasing  function  of  x and  (iv)  holds  using  (14)  gives  that 

(v)  holds. 

Having  established  (i)-(v)  we  will  now  prove  the  conditioned 

limit  theorem  by  checking  the  hypotheses  of  Theorem  3.10.  The 

first  two  steps  are  easy.  Since  (V  (T.~)  -£)  si  1/c  ->  0 it  is 

n t-  n 

immediate  from  Theorem  3.7  that  V+  is  tight  for  x -»  0 . To  get  the 

n b n 

0,  . , 

asymptotic  formula  for  Q [N  > n]  we  observe  that  from  40  J p.  253 

0 , — p, 

we  have  Q (N>  n)  - n ' L(n)  where-  p = a /OL  -kl  . 

To  complete  the  proof  we  have  to  show; 

Theorem  2 . If  V is  a diffusion  which  can  occur  as  a limit  in 

Theorem  1 then  lim  (VX|  T > 1)  exists. 
xiO 

Proof . 

Suppose  V is  defined  on  a probability  space  with  j-fields 
3 ~ ct(V(s):s  £ t]  and  shift  operators  (0  ; t a 0]  . Lot  Sf  = 

inffs>  0:V(s)  = £ , V(u)  > 0 for  s < u i s+1 ) and  let  Z^( t)  = V (S^+t) . 


1 

I 


J 
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r X 

Lemma  1 For  £,  > 0 and  all  x Sc  < ® p almost  surely.  As 


£j0  S IS  and  Z<-->  Z„  P almost  surely. 
£ 0 c.  0 


Proof . 

0 k+1  k 

For  £ > 0 let  R£  = -1  and  R£=t  inf  f t ;>  +1  :V(t)  = £] 

If  y ^ £.  then  from  [39],  p.  53: 


Py{R'L<a>}  = lim  Py[  x.  < 

M-)CO 


e ‘ (y-£)M 


J(x)  - J((y-£)M) 
J (£)  - J((y-OM) 


so  using  the  strong  Markov  property  and  induction  gives  that 
x k 

P {R£  < oo}  = i for  all  x and  k.  Now  if  V has  no  zero  in 


[r£,R£  + l]  then  S£  <;  so 


PXfS£  ^ R*l  St  ">  R*_l]  > pEfT0>l}>0 


and  hence 


P |SC  < ®1  ~ l . 


For  0 s ft  < t,  S S supf t < S£:V(t)  = fil  so  S£t  as  Zl 
To  see  that  Sc  i S note  that 

^ I ) 


p = infft-S  -l:t>  S V(t)  = 0]  > 0 


so  ^v(S  +\d)_  ,s0  r'  ^or  ^ ^ < 1.  Since  V has  continuous 

paths  and  Z£(t)  ^V(S£+t),  S£i0  implies  Z^->  Z 


Having  proven  Lemma  1 to  complete  the  proof  of  Theorem  2 it 
suffices  to  show; 
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Lemma  2.  For  £.  > 0 and  (V^j  T > 1)  have  the  same 


distribution . 


Proof . 


Let  F be  a Borel  subset  of  D.  Clearly, 


PfZ^cF}  P(Zec:F,S£  = + P{Z^:F(Se>  t£] 


Since  t is  a stopping  lime  and  V a strong  Markov  process 


P{Z£eF}  = E[P(ZGeF,Se=  Te|  5t  )] 


PfvS-F.T  > 1) 


If  S^>  then  V(s)  = 0 for  some  se(x£, t^+  l].  Letting 

•r^=  inff s:se (t^,  + l],  V(s)  = 0}  where  t'£  = » if  the  last  set  is 

empty,  wo  have 


p;Vr'st>  rd  - p(ze-E're< 


EtTE<";Ea[^rllht)] 


On  the  set  t'  < «)  , 1 , can  be  written  as  b(P  ) so  from  (3) 

£ r_ 

and  the  strong  Markov  property  we  get 
P:  z^;l-  ,S£  > ; } = (E°«5)P[  t£  < 

= P{Z£cF}(1  - PC'[T0>  1])  (4) 


Combining  Cl),  (2),  and  (4)  gives 


♦Note:  when  P is  written  without  a superscript  the  indicated  probability 
is  independent  of  the  initial  distribution. 
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P(ZefFl  = P[V  eF,TQ  > 1}  + PfZeC.F]  (1  - P^'  > 1]) 


PfZ^eF]  = P(V  gF|T0>  1) 


which  proves  Lemma  2. 


This  completes  our  development  for  the  "regular"  case;.  The 
next  step  is  to  determine  in  what  other  cases  we  can  get  a nontrivial 
conditioned  limit  theorem. 

To  do  this  we  observe  that  from  (16)  and  (18)  of  Section  8.1 
0,  - , 0 

either  P { T^  = 0 1 = 1 or  V SO  so  if  V is  not  regular  there  is 

no  loss  of  generality  in  assuming  the  state  space  is  [0,«) . In 

Section  3.1  we  argued  that  if  0 was  inaccessible  from  positive 

levels  then  the  limit  theorem  is  trivial  so  we  will  assume 

PX[ T > t}  & 1.  In  this  case  (13)  of  3.1  implies  lim  PX(T  > t]  = 0 

0 0 xi0 

so  (12)  of  3.1  gives  P { TQ  = 0]  =1.  Since  P ( T+  = 0)  - 1 if  and 
only  if  P (V  (1)  > 0}  > 0 there  are  only  boundary  possibilities  to 


consider 


(a)  reflecting:  P^  [ T*  - 0}  = P^fT^  = 0}  = 1 


(b)  absorbing:  V --  0 


Conditions  for  convergence  in  these  cases  can  fie  obtained  from 


Theorem  3.  Let  (U(t),t  i:  0)  be  a birth  and  death  process  with 


state  space  [0,1,2...). 

If  0 is  a reflecting  boundary  for  V then  IJ(n’)/c  a V and 


defined  in  Theorem  1 has 


(iv)  holds  if  and  only  if  the  sequence  K 
-1  ct-y-y  l2~l 

(Xyy)  - n (n)  and  nn  = n L(n)  where  cy  and  y'^  are 

positive  and  the  L.  have  lim  L . (Sx)/L  . (P>)  - 1 for  all  x > 0. 

0-»CO 

If  0 is  an  absorbing  boundary  for  V and  X.  = 0 in  U then 
U(n  )/cy  =s  V and  (iv)  holds  if  anti  only  if  in  addition  to  the 
conditions  stated  above  we  have 

x u(zc  ) 

■■  n n 

lira  lim  — r—  v (dz)  - 0 

- j u(c  ) n 

x-»0  n-*»  0 n 


where  v (x)  = (v(xc  ) - v(c  ))/(v(2c  ) - v(c  >),  v(i)  = S n . and 
n n n n n i 

j=l 

u(i>  = s (x  nyl. 

j=l  3 3 

i/a1+o2 

In  each  case  c^  = n L(n)  and  there  are  positive  constants 

A and  B so  that  the  limit  process  is  a diffusion  with  scale 
J(x)  - Ax  1 x 0 and  a speed  measure  m concentrated  on  (0,°=) 


given  in 


m(x) 


li  „2  / 0 


B log  x if  k(  = 0 


If  u„  > 0,  0 is  a reflecting  boundary.  In  the  other  eases  0 is 
absorbing . 

Since  Theorem  3 gives  conditions  for  (ii)  and  (iv)  to  hold  and  the 

arguments  given  above  for  ( i i i ) and  (v)  still  apply,  wo  have  that  (i)- 

(v)  hold.  From  Theorem  3.7,  V+  is  tight  for  x ->  0 . 

n n 

If  0 is  a reflecting  boundary  it  is  easy  to  use  Theorem  3.10  to 
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show 


converges;  a similar  argument  works  to  show 


lim(ve|  T > 1) 

£:  u 


exists  (we  only  have  to  change  the  proof  that  PXSf  < ^1)  and 

- ' / < -e  . 

it  follows  from  [40],  p.  253  that  Q { N > n]  --  n ^ 1 “ T.Cn). 

If  0 is  an  absorbing  boundary,  however,  both  of  these  arguments 
fail.  We  leave  it  to  the  interested  reader  to  decide  whether  the 
conditioned  limit  theorem  will  hold  in  general  in  this  case. 


i 


H 


I 
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4.4  The  M/G/I  Queue; 


In  the  M/G/l  queue  customers  arrive  at  tin.  jump  i inn.-s  < r a 
Poisson  process  A(t) , t a 0 with  rate  and  have  service  Limes 
which  are  independent  positive  random  variables  with  the  same 
distribution. 

If  5 . denotes  the  amount  of  service  required  bv  the  i 
'l  A ( t ) 

customer  to  arrive  after  time  0 then  S(t)  ---  . t . is  the  amount 

. . t 

i ■ i 

of  work  that  has  arrived  at  the  facility  at  time  t . It  the  initial 

backlog  of  work  is  x and  the  server  i « not  idle  at  any  moment 

he  fore  t then  L(t)  - x+S(t)-t  is  the  amount  at  work  not  completed 

at  time  t.  If  the  server  has  been  idle  then  w<-  have  to  add  to  this 

number  the  amount  of  time  he  has  • r.  t M>  - t he  amount  of  work  that 

remains  in  general  is  giver  by  VO  1 l.<  )-/  mm  L(s)\ 

(t  ,■  t t 

It  is  easy  to  use  Itonsker'-  r,  r-  . sir  conditions  for  V 

to  satisfy  (it) 


Theorem  1.  Suppose  K?  1 and  Ft 1 , - 1 /• ) - n a (0  .<») . If 

x/2.  i /y. 

x ->  x ;>  0 then  (V(n  )/jn  !v(0)  x rn  ) com  e rges  to 

n tv 

(B|  B(0)  =•  x)  where  B is  reflecting  Brown i .n  mot  ioi.. 


Proo  f . 

S(t)  is  the  sum  of  a Poisson  number  of  independent  random  variables 

1/2 

with  mean  E£  so  lrom  _ 20  J Theorem  17  2 fx(n  • )-‘  (E?  )r.t)/->» 
converges  to  a Brownian  motion  B.  From  this  it  follows  that  i1 
xn-»  x s 0 (L(n-)/cTnI/2|  L(0)  , x^ctii1  2)  converges  to  (b|b(o)  \ ) 


1 i 


\ 

[ 

5-- 

[■» 

[ J 


I 


i 


1 


and  the  desired  conclusion  now  follows  from  the  continuous  mapping 
theorem. 

Since  the  limit  in  Theorem  1 is  reflecting  Brownian  motion 

(iii)  holds.  To  see  that  (iv)  and  (v)  are  satisfied  we  observe  that 

if  x -*  x S 0 and  t -»  t > 0 
n n 


P / inf  V ( n s ) > 0 | V(0)  = x cnl/2j 

UKss  t n ' 

n 

- p/  inf  L(ns)  > 0 I L(0)  x 

lo-isst  11  / 

n 

-»  P / inf  B ( s ) > 0 | B(0)  = x) 

lOssst  ' 

= P/  inf  Bfs)  > 0 | B(0)  = x\ 

UKsSt  I 


Having  verified  (i)-(v)  the  ne.t  step  is  to  compute  the  asymptotic 
formula  for  the  probability  of  the  conditioning  event.  To  do  this  we 
will  use  the  Laplace  transform. 

Let  T0  " inf{t  >0  :U(t)  0] 

"c/1o 

Let  A (Ct)  = E(e  |u(0)  x> 

x 1 


Since  the  arrivals  form  a Poisson  process  we  have 

A («)  = A (-,}A  ( ) 

x+y  x y 

and 

A (it)  - c tx  r A (rt)r(S(x)£dv) 

X y 

(0  ,«) 

From  (1)  it  follows  that  there  is  a number  p(o)  so  that. 


(1) 

(2) 
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• -tT  If4*'”" 


r 


I ' 

h 


* 

i> 


0 (a)  - e >n(  l)  . Using  this  fact  in  (2)  gives 

X 


-xTi(a) 

e = e E(e 


Now  if  9(iO 
written  as 


E(e  then  E(e  '“v'w)  = e 


-r'XE(e-Tl(a)S(x)) 

-fiS(x).  -?  x ( 1 -6  ( p ) ) 


(3) 

so  (3)  may  be 


x T) (o  ) = x(  1-0  (r)  (f  i)  ) ) 


h(a)  = a + ?->.9  (h(ct)) 


(4) 


/ 

If  H is  the  distribution  of  | , Takacs  ([46],  pp . 47-49)  has 


shown  that,  equation  (4)  has  a unique  positive  solution  given  by 

« j-1 


ri(a)  - + ' 


1-  Lj 


j=i 


,.i  ■ 


e-('  + ')xxi-1ir^(dx) 


(5) 


i * 

where  denotes  the  ,j-fold  convolution  of  H. 

Writing  y ( i)  for  the  sum  in  (5)  we;  have 


, -xq(u)  — X ( \ (1  ~y  ( t)  ) ) 

/ (a)  = e = e 

X 


Brody  ([43],  p.  78)  has  shown  that  if  = 


< ® then 


1 /2  I /’’ 

1 - v (a)  - (2/.  .J  o “ as  aiO 


-»<(■)  ~ x>  (2/ „ )l/2a1/2  as  t,{< 

X ^ 


Using  a result  of  Dynkin  ( 4 l] , p.  1 79)  n<  >w  shows  that 


1/2  -1/2 

PCI  > l J L(0)  - x)  " x>(2/n.i  ) t as  Xtoo 

0 ^ 
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At  this  point  we  arc  ready  to  use  Theorem  3.10  to  prove  the 

conditioned  limit  theorem.  From  results  in  4.1  or  4.3  we  have  that 

lim  (VX|  T > 1)  exists  so  it  remains  to  show  that  the  sequence 
xiO 

is  tight.  To  do  this  we  will  imitate  the  proof  given  in  Section  4.1. 
Let  = inf(j  a 1:|  > licn^2}  . 


Qa[T0  > n,J l <“)  * £ / P(T0  > ns.jJ  = A_1(k),  feds  } 


w J. 

= E f P(Tq  > ns|A~1(k)  = nsfj”  = A_1 (k) ) 


k=l  0 


X P(j“  = A I(k)|A  ■‘(k)  = ns) P 


A !(k) 


oo  1 

£ E f P(T  > ns|  A A(k)  = ns) 
k=l  ' 0 


. , , l/2,k-l„,.  , 1/2,  (ns)k"1e'nsA  , 

X P(£  5 !lCn  } P(f,  - Ipn  j ds 

1 1 k-1 ! >, 


Since  P(T^  > ns|  A (k)=ns)  S P(T^  '>  nsl A(ns)=k-I ) the  expression  above 


r,  \ 1P(f  > hjrt1^2]  E f P(T^>  ns|  A(ns)  = k-l)r  nsA"  ds 

k 1 0 U 


•1  . r , 1/2,  n 

P[P  > lbn  ) [ p(T  > ns]fjs 

u 


Dividing  by  Q (Tq  > n)  gives 


Q‘  (Jj  < °°l  T0  > n)  ~ \ > hjnl/,“)  — 


f Ql'f  T > ns)  ds 


nQ'V0  > nJ 
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Since  has  finite  variance  nP{£^  > hjn  ) -»  0 as  n ->  “>.  Now 

a -1/2  / 

q"  (T  > n]  = n L(n)  so  using  Karamata's  theorem  gives 


r QacT0 > ns3  ds 

_0 

nQa{TQ  > n} 


and  Qa[J^  < mj Tq  > h]  -»  0.  To  complete  the  tightness  proof  we  use 


the  same  arguments  which  were  used  in  Section  4.1  for  the  case  CC  = 2. 


4.5  Conditioning  on  > n when  B is  a Bounded  Set 

In  this  section  we  will  extend  the  results  of  Chapter  3 to  study 

n 

the  effect  of  conditioning  a lattice  random  walk  S - S_+  2T  X.  on 

n 0 n i 

l-l 

N > n where  N = inffm  2 1:S  eB';  and  B is  a finite  set.  We  will 
B B m 

leave  it  to  the  reader  to  check  that  the  arguments  given  below  apply 
to  the  random  walks  studied  in  [l4jt  and  that  many  of  the  results 
below  hold  in  the  generality  suggested  by  the  title. 

The  organization  of  this  section  is  the  same  as  tnat  of  the  previous 
four.  We  will  first  verify  that  (i)-(v)  hold  and  then  show  the  results 
of  Section  3.3  can  be  applied  to  conclude  the  desired  conditioned  limit 
theorems . 

Necessary  and  sufficient  conditions  for  (ii)  to  hold  were  given 
in  Section  4.1,  From  results  there 


PXI  inf  { f (s) f > o!  S PX [ T > t)  > 
joss-St.  | 


so  (iii)  holds.  To  check  that  (V  I N'  > nt  ) converges  when  x -»  x > 0 

n 1 B n n 

and  t -*  t > 0 requires  more  work. 

" ( ) 

Let  T (f)  = inf  jt  ^ 0:  inf  J f < <3 ) f 0>.  Now, 

I (Ksst  ) 

d(T  '>  t]  ^ (T_.=  tliiif:  inf  f(s)  - 0 or  sup  f(s)  - o| 

t°l  '-0]  I (>-:  s-t  t Ossst  ) 


P t]  - P(V(t)  . 0}  = 0, 


so  i f x>  0 and  P°[T()  - °]  = 1 , it:  follows  from  the  strong  Markov 

x 

property  that  PX(dfT  > t]  ) =0  and  P^fN^  > n P > t) 


whenever  x ->  x > 0 and  t -»  t > 0 . 
n n 

Let  A = (N,,  > nt  ] . For  all  £ > 0 
n 1 B n 


LIMNF  A — f:  inf  |f(s)|  >Z 

n Oss^t 


LIMNF  A I>  f f :T  . (f)  > t} 
n 1 (0) 


I 


and  using  Theorem  2.-1  gives  (V  n|  N > nt  ) =s  (VX|  T . , > t) 

n ' B n 1 [0] 


To  show  that  (v)  holds  let  T^L  = inf  { t;V(t)£[ and  observe 


that  if  -*  0 and  n is  sufficiently  large 


n,„c 


Pn  ^NB>  n]  * Pn  1/21  + E 


V no£) 
n t. 


\ < 1/2 ;P  (Nb  > n(l-T^)) 


c 0 

If  t is  such  that  T_  is  P a.s.  continuous 


lim  P n(NB>  n]  <;  P°{t|;>  1/2}  + E 

rv->cc 


v°(t£) 

1/2;P  {T{0)  > 1-tJ] 


Letting  tlO,  PP(T^&  1/2}  J 0 and  1 x < 1/2}  ^ ® 80  the  result 

follows  from  the  fact  that  PX{T^^  > t}  l 0 for  all  t>  0. 

If  Q‘  > n}  decreases  to  a positive  limit  then  the  methods  of 
Section  3.2  can  he  used  to  show 


(V;n-]/cJ  V0  = a’NB>  n)  =*  V 


so  for  the  rest  of  the  section  we  will  assume  Q (N  > n}IO,  that  is. 

B 

S is  recurrent, 
n 
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Using  Theorem  3 of  Section  4.1  and  Theorem  1.3  of  [ 4 ],  a random 

walk  in  the  domain  of  attraction  of  a stable  law  of  index  a is 

00 

_2 

recurrent  if  u > 1 and  EX  =0  or  a = 1 and  f P{jx  | > u)  u du  = 

1 1 1 
oo,  so  we  will  restrict  our  attention  to  these  cases. 

If  a = 1 then  pX(Tf0-)  > t)  5 1 for  all  x A 0 (see  [28], 

Theorems  3.1  and  5.4)  so  from  the  arguments  in  Section  3.1  if  the 

limit  exists  in  the  sense  of  (a)  ; V^.  In  previous  sections  we 

have  eliminated  such  cases  but  in  this  instance  we  will  not  because 

the  situation  has  been  studied  by  Belkin  and  his  results  indicate  there 

are  technical  complications  which  make  the  "trivial"  case  the  hardest 

of  all. 

To  describe  Belkin's  result  we  have  to  introduce  some  of  his 
notation: 

for  n 2 0 let  Qy(x,y)  = P(S^  = y,N0  5 n|  SQ  = x) 

CO 

let  g (x,y)  = E Q„(x,y)  . 
n=0 

gB(x.y)  is  the  expected  number  of  visits  to  y starting  at  x 
up  to  and  including  the  first  visit  to  13.  It  is  known  (see  [4j)  that 


Lemma  1 . 

2 

If  ex2 

= oo  then 

s(x) 

- lim  g (x,y)  exists. 

| y|-*»  R 

2 

I f EX 

< oo  then 

Kn(x) 

= 7T  Hm  [ Kjj(x  , y>  + Kp(x  , -y)  ] exists 
y->°° 
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The  reason  for  our  interest  in  this  quantity  is  explained  by 
the  next  result  (which  comes  from  [4],  p.  148). 


Lemma  2 . Let  B bo  a finite  set,  B+  = (n:n  > sup  B] , 

B = fn:n  < inf  B}  , and  C = B I.  B . 

1 ‘ ’ + 


If 

EX, 

< 00 

then 

KB(x)  > 0 

if 

and 

only 

if 

PX(NC  < V > 0 

If 

— 00 

then 

g0(x)  > 0 

if 

and 

only 

if 

PX(NB  < nb}  > 0 

+ 

and  Px 

V 

> 0. 

It  is  clear  that  P fNc  < N ] >0  is  necessary  for  a nondegenerate 

x 

conditioned  limit  theorem.  The  reason  for  requiring  P {N  < N ) and 

B B 
+ 

Px(N^  < Mg)  >0  is  less  obvious  but  the  need  for  this  condition  will  be 

indicated  later.  To  justify  assuming  g (x)  >0  at  this  point  we 
observe  that  this  condition  holds  if  the  limit  distribution  has 
a < 2 and  | b I <1. 


Theorem  1.  ([4],  p.  158)  Let  B be  a finite  set  with  gg(0)  > 0 

and  let  F be  the  distribution  of  X^  . 

If  F belongs  to  the  domain  of  attraction  of  a stable  law  of  index 

1 < a 2 and  EX^  =0,  or  F belongs  to  the  domain  of  normal 

x 


-x 


attraction  of  a stable  law  of  index  ,-t  = 1 and  1 im  J yF(dy)  = u.(finite) 
then  for  every  real  number  y 


“■  PB„/C»  5 '|s„  = »,»„>■)  = H <y> 

IW»  ’ 

where  H is  a probability  distribution  with  characteristic  function 

O'.  . B 


72 


B 


given  by  the  following  formulas: 


\j/_  and  a density  h 


If  I £ a < 2 and  EX^  = co  then 


i|<.  B(t)  = 1 - c|  t|a(l+b^(t>) 


x(1/:  < 1T  ( t (1  -x) 17  ')  dx 


where  n is  the  character! stir,  function  of  the  limit  of  F (<_  • ) . 

1 n 

2 2 

If  Q = 2 and  EX^  ~ j < <a  then 

h n(x)  = (2o2)  1exp(-x2/2a‘')[  I xl  - (xES  /a 2g  (0) ) ] 

At  this  point  if  we  were  conditioning  on  TQ  > n we  could  use 
Theorem  3.9  to  conclude  that 

V*  = (Sr  We  I S - 0 N > n) 
n [ n • j n1  0 ’ B 

converges  weakly  to  a limit  process  with  finite  dimensional  distributions 
given  by  (2)  and  (3)  ol  Section  3.3. 

Although  Theorem  3.9  cannot  bo  applied  the  same  proof  can  be  used 
to  give  the  result  desired.  Returning  to  Section  3.3  we  see  that  to 
conclude  convergence  of  finite  dimensional  distributions  we  needed  (in 

-r  * 

addition  to  the  convergence  of  V (1)  to  v ^ 0)  that  equation  (4) 

n 

was  valid  and  (iii)-(v)  hold;  while  to  prove  tightness  we  needed 
Theorems  3. 3-3. 5 of  Section  3.2  which  hold  as  long  as  the  post-T^ 
process  converges  and  lim  P'x(t  i 1]  - 0 

With  slightly  more  effort  we  could  also  prove  the  convergence  of 

# ... 

V using  an  analogue  of  Theorem  3.10.  Millar  (131  J,  Lemma  1.5)  has 
n 

shown : 


73 


j 

i 


i 


i ■ 

i • 

i 


Theorem 


2 , Let  p be  the  density  of  V ( t) . Let  f be  a 


bounded  Borel  function. 

Let  Q f = J f (y)q  (y)dv  where 


nt(y)  = (y/t)e 


-y2/2t 


if  a = 2 and 


> (y)  + f[P.  (y)-P  (v>]s(1/a>  2ds  if  l < n < 2 

t 2a-\  J t t-s 

0 


If  1 C a < 2 and  J bj  < 1 then 


lim  Exf(v(t))i  t/Px{Tfor  t]  = V 

x->o  1 (or  *•  J t 


If  r = 1 and  xlO  or  = -1  and  xt 0 then  the  same  result 


holds . 


If  a = 2 


lim  E |f(V(t»|l  > t]/P  (T(0)  > t]  = Qtf  . 


x-»0 


From  this  we  see  that  if  1 < C£  < 2 and  | bj  <1  then 

lim(VX 
x-»0 


J > 1)  exists  and  the  methods  of  Theorem  3.10  apply. 


=••  2 or  | b|  =1,  however,  the  limits  are 

xfO  (see  i 30]  Lemma  1.6  for  the  case  j b|  = 

with  Theorem  3.10  we  would  have  to  show  lim 

tiO 

If  u =2.  we  can  use  Belkin's  result. 


different  for  xlO  or 
1)  so  to  prove  convergence 
lim  P{V^(t)  > 0]  exists. 

n->o= 

Comparing  the  limits  in 
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r 


i' 


Theorems  1 and  2 in  this  case  we  see  that  for  all  t > 0 


lim  P 
n->c° 


> 0]  (1 


(ES  /^g  (0)))  = p 

nb  B h 


jf 

so  V converges  to  a process  which  is  positive  at  all  t > 0 with 
n 

probability  p and  negative  at  ali  t > 0 with  probability  1-P^. 

If  i < a < 2,  | bj  =1  and  g (0)  > 0 a similar  analysis  can 
ho  performed  to  identify  the  limit.  Since  this  involves  manipulating 
the  transform  in  Theorem  1 and  does  not  give  us  much  now  information, 
wc  have  not  done  these  calculations. 

Wc  close  this  section  by  giving  an  example  (due  to  Belkin  [ 4 ], 
pp.  162-163)  which  shows  what  can  happen  when  j b|  = L and 


gB<0)  = 0. 


Example . Let  F be  a distribution  function  for  an  integer  valued 

random  variable  wi th  PfX^  g -2]  = 0 and  suppose  F is  in  the 

domain  oi  normal  attraction  of  a stable  law  of  index  0,  with  1 < a < 2. 

Lot  B - [-1] . Since  P°(N  < N ) = 0 it  follows  from  Lemma  2 

that  £^(0)  = 0 :mc*  Theorem  1 cannot  be  applied.  There  is  a good 

reason  for  this:  the  conclusion  of  Theorem  1 is  false.  Belkin  has 

shown  that  (S  /c  |S  - 0,N„  ->  n)  converges  to  a random  variable 
n n n ’ B 

with  characteristic  function 


1 - c, 


tjc/a+w.  (t>) 

1 a 


T x (1/a)n(t(i-x)1/w)di 


1 


i 

J 

J 
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ABSTRACT 


^-■^Let  U,\  be  a discrete  time  Markov  process  with  state  space  E and 
let  S be  arproper  subset  of  E.  In  several  /applications  it  is  of  interest 
to  know  the  behavior  of  the  system  after  a large  number  of  steps  given 
that  the  nrocess  has  not  entered  S.  For  example  if  U is  a branching 
process  a limit  theorem  of  this  type  gives  information  about  the  size  of 
the  kth  generation  given  that  extinction  has  not  occured  by  time  k. 


Seneta  and  Vere-Jones  have  given  sufficient  conditions  for  the 
conditioned  sequence  to  converge  (without  normalization)  when  the  state 
space  is  discrete.  Their  results  can  be  applied  to  sub-critical  branching 
processes.  If  the  chain  is  null  recurrent  or  transient,  however,  all 
their  limits  are  zero  so  we  have  to  divide  by  constants  which  tend  to 
infinity  to  obtain  an  interesting  limit  theorem. 


In  this  instance  the  most  desirable  type  of  result  is  a functional 
limit  theorem,  i.e.  a result  asserting  the  convergence  of  a sequence  of 
stochastic  processes  derived  from  the  sequence  of  observations.  This  was 
the  goal  in  several  previous  studies  but  in  most  cases  the  results  ob- 
tained are  incomplete  due  to  problems  with  the  tightness  argument. 

It  was  the  presence  of  these  technical  difficulties  which  motivated 
this  investigation.  The  remedies  we  have  developed  allow  us  to  state 
general  conditions  for  the  conditioned  processes  to  converge  when  S is 
a half-line  or  bounded  set. 

Our  results  can  be  applied  to  null  recurrent  Galton-Watson  branching 
processes  (when  the  offspring  distribution  has  a finite  second  moment) , 
to  random  walks  in  the  domain  of  attraction  of  a stable  law,  to  the 
waiting  time  process  of  the  M/G/l  queue  (when  the  service  distribution 
has  finite  second  moment) , and  to  birth  and  death  processes  in  the  domain 
of  attraction  of  a diffusion  which  is  regular  or  has  zero  as  a reflecting 
boundary.  The  limit  theorems  we  obtain  in  this  way  generalize  and 
complete  several  results  in  tiie  literature. 

An  Important  aspect  of  our  methods  is  that  the  main  theorem  is 
deri”ed  from  a set  of  basic  assumptions  so  if  a person  is  interested  in 
a conditioned  limit  theorem  not  included  in  the  list:  above  he  can  apply 
our  results  directly  instead  of  adapting  one  of  our  proofs  to  meet  his 
needs  . 

A second  feature  of  our  solution  which  deserves  mention  is  that  in 
the  development  of  the  main  theorem  we  prove  a result  which  gives  con- 
ditions for  the  convergence  of  the  conditioned  measures  P ( * i A ) when 
P converges  to  P and  inf  P (A  )>  0.  As  the  reader  may  expect  our 
conditions  are  that  the  sets  \ converge  to  A in  an  appropriate  sense 
and  that  A may  be  approximated  from  the  inside  (or  outside)  by  sets  G 
which  are  P-continuity  sets.  m 
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